Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method

ABSTRACT

An image display apparatus includes a stereoscopic image display apparatus configured to display a stereoscopically visible image, and a planar image display apparatus configured to display a planar image. An adjustment section of the image display apparatus adjusts relative positions, relative sizes, and relative rotations of a left-eye image taken by a left-eye image imaging section and a right-eye image taken by a right-eye image imaging section. The adjusted left-eye image and the adjusted right-eye image are viewed by the left eye and the right eye of the user, respectively, thereby displaying the stereoscopic image on the stereoscopic image display apparatus. The adjusted left-eye image and the adjusted right-eye image are made semi-transparent and superimposed one on the other, and thus a resulting superimposed planar image is displayed on the planar image display apparatus.

CROSS REFERENCE TO RELATED APPLICATION

The disclosure of Japanese Patent Application No. 2010-005955, filed onJan. 14, 2010, is incorporated herein by reference.

BACKGROUND

1. Field

Example of embodiments of the present invention relate to a displaycontrol program, a display control apparatus, a display control system,and a display control method, for adjusting a three-dimensionalappearance when a stereoscopic image is displayed on a display devicecapable of displaying a stereoscopically visible image.

2. Description of the Background Art

Conventionally, there have been stereoscopic image display apparatuseswhich display stereoscopic images by using a right-eye image and aleft-eye image having a parallax therebetween. Specifically, in thestereoscopic image display apparatuses, an image having a stereoscopiceffect is displayed on a screen, by causing a user to view the right-eyeimage with his/her right eye, and the left-eye image with his/her lefteye. In such stereoscopic image display apparatuses, there are deviceswhich adjust the stereoscopic effect of the displayed image. Forexample, Japanese Laid-Open Patent Publication No. 2003-264851(hereinafter, referred to as Patent Literature 1) discloses an apparatuswhich adjusts a stereoscopic effect of a displayed image by adjustingrespective positions, sizes, and rotations of right-eye and left-eyeimages on a display screen, which are taken. Specifically, in theapparatus disclosed in Patent Literature 1, the right-eye image and theleft-eye image are superimposed one on the other to be displayed on onescreen, and the user adjusts the respective positions and rotations ofthe two images displayed on the one screen. After the adjustment of thetwo images, the user displays the two images as a stereoscopic image andverifies the stereoscopic effect of the image.

The apparatus disclosed in Patent Literature 1, however, does not allowthe user to adjust the respective positions and rotations of theright-eye and left-eye images while the images are beingstereoscopically displayed on the screen. That is, with the apparatusdisclosed in Patent Literature 1, the user adjusts the respectivepositions, and the like, of the two images superimposed one on the otherin a planar manner and displayed on the screen, and thereafter displaysthe two images stereoscopically to verify the stereoscopic effect of aresulting image. Thus, the user cannot verify the stereoscopic effect ofthe stereoscopically displayed image during the adjustment of thesuperimposed two images. On the other hand, in the state in which theimages are stereoscopically displayed on the screen, the user needs tomake adjustment of the two superimposed images in a situation in whichthe stereoscopic display is poorly visible and additionally, it isdifficult for the user to view the two images individually. Therefore,it is difficult to make adjustments while the images are being displayedstereoscopically on the screen.

SUMMARY

Therefore, an object of the present invention is to provide a displaycontrol apparatus, a display control program, and a display controlsystem, which allow the user to easily adjust the stereoscopic effect ofthe image.

In order to achieve the object, example embodiments of the presentinvention employ the following features.

An embodiment of the present invention is a display control programexecuted by a computer of a display control apparatus for displaying astereoscopic image on first display means configured to display astereoscopically visible image by using a right-eye image and a left-eyeimage which have a parallax therebetween. The display control programcauses the computer to function as: adjustment means, first displaycontrol means, and second display control means. The adjustment meansadjusts at least one of relative positions, relative sizes, and relativerotations of the right-eye image and the left-eye image. The firstdisplay control means displays on the first display means the right-eyeimage adjusted by the adjustment means and the left-eye image adjustedby the adjustment means so as to be viewed with a right eye and a lefteye of the user, respectively, to display the stereoscopic image on thefirst display means. The second display control means superimposes theright-eye image adjusted by the adjustment means and the left-eye imageadjusted by the adjustment means one on the other, and displaying aresulting superimposed planar image on a second display means configuredto display a planar image.

According to the above configuration, the stereoscopic image can bedisplayed on the first display means by using the right-eye image andthe left-eye image, and the planar image in which the right-eye imageand the left-eye image are superimposed one on the other can bedisplayed on the second display means. Furthermore, respectivepositions, respective sizes and respective rotations of the right-eyeimage and the left-eye image can be adjusted. This allows the user toadjust the respective positions, the respective sizes, and therespective rotations of the right-eye image and the left-eye image whichare displayed on the second display means, while seeing the stereoscopicimage displayed on the first display means.

Further, in another embodiment of the present invention, in the casewhere the right-eye image adjusted by the adjustment means and theleft-eye image adjusted by the adjustment means are superimposed one onthe other, the first display control means displays on the first displaymeans merely a superimposed area, which is a superimposed portion of theright-eye image adjusted by the adjustment means and the left-eye imageadjusted by the adjustment means, of the stereoscopic image. In thiscase, the second display control means displays on the second displaymeans a non-overlapping area which is a portion where the right-eyeimage and the left-eye image are not superimposed one on the other, inaddition to the superimposed area of the right-eye image and theleft-eye image which are adjusted by the adjustment means.

According to the above configuration, the user can adjust thestereoscopic image displayed on the first display means, while verifyingthe portion, in which the right-eye image and the left-eye image aresuperimposed one on the other, and the portion, in which the right-eyeimage and the left-eye image are not superimposed one on the other,which are displayed on the second display means. Since only the portionin which the right-eye image and the left-eye image are superimposed oneon the other is displayed on the first display means, the stereoscopicimage displayed on the first display means causes no sense ofdiscomfort. On the other hand, since the superimposed portion and thenon-overlapping portion are displayed on the second display means, theuser can easily understand the positional relationship of an object tobe imaged, which is displayed on the two images. In addition, forexample, even if an object to be imaged, which is desired by the user toview, is present in the non-overlapping portion, the user can easilyadjust the right-eye image and the left-eye image, while seeing theimages displayed on the second display means.

Further, in another embodiment of the present invention, the firstdisplay control means may perform zoom the stereoscopic image bychanging the respective sizes of the right-eye image and the left-eyeimage.

According to the above configuration, the stereoscopic image displayedon the first display means can be zoomed.

Further, in another embodiment of the present invention, the firstdisplay control means may scroll the stereoscopic image by changing therespective positions of the right-eye image and the left-eye image.

According to the above configuration, the stereoscopic image displayedon the first display means can be scrolled.

Further, in another embodiment of the present invention, when the firstdisplay control means scrolls or zooms the stereoscopic image, thesecond display control means may display on the second display means anentirety of the right-eye image and an entirety of the left-eye image.

According to the above configuration, even when the stereoscopic imagedisplayed on the first display means is zoomed or scrolled, the entiretyof the right-eye image and the entirety of the left-eye image can bedisplayed on the second display means. This allows the user to verify onthe second display means the entirety of the right-eye image and theentirety of the left-eye image, even when merely a portion of thestereoscopic image is displayed on the first display means because ofthe stereoscopic image being zoomed or scrolled.

Further, in another embodiment of the present invention, in the casewhere a portion of the stereoscopic image is displayed on the firstdisplay means by performing zooming or scrolling of the stereoscopicimage by the first display control means, the second display controlmeans may display on the second display means a stereoscopic imagedisplay frame indicative of respective areas of the right-eye image andthe left-eye image which correspond to the portion of the stereoscopicimage. Here, the stereoscopic image display frame indicates respectiveareas of the right-eye image and the left-eye image, which correspond tothe portion of the stereoscopic image.

According to the above configuration, the user can easily recognizewhich areas of the right-eye image and the left-eye image displayed onthe second display means are displayed on the first display means as thestereoscopic image. That is, when merely the portion of the stereoscopicimage is displayed on the first display means because of thestereoscopic image being zoomed or scrolled, it may be difficult for theuser to recognize which areas are displayed stereoscopically. However,displaying the stereoscopic image display frame on the second displaymeans allows the user to easily recognize which areas, among theentirety of right-eye and left-eye images, are displayed.

Further, in another embodiment of the present invention, designatedcoordinate detection means for detecting a designated coordinatecorresponding to a display position on the second display means may beconnected to the display control apparatus. In this case, displaycontrol program further causes the computer to function as firstadjustment bar control means. The first adjustment bar control meansdisplays a first adjustment bar on the second display means, and adjustsa slider of the first adjustment bar, according to the designatedcoordinate detected by the designated coordinate detection means. Then,the adjustment means adjusts at least one of the relative positions, therelative sizes, and the relative rotations of the right-eye image andthe left-eye image, according to a position of the slider, of the firstadjustment bar, which is adjusted by the first adjustment bar controlmeans.

According to the above configuration, the user can adjust the relativepositions, the relative sizes, and the relative rotations of theright-eye image and the left-eye image by adjusting the first adjustmentbar displayed on the screen by using the designated coordinate detectionmeans. For example, the user can adjust the right-eye image and theleft-eye image by using a touch panel. This allows the user to adjustthe appearance of the stereoscopic image by performing an intuitiveoperation.

Further, in another embodiment of the present invention, the displaycontrol program may further cause the computer to function as secondadjustment bar control means. The second adjustment bar control meansdisplays a second adjustment bar on the second display means, andadjusts a slider of the second adjustment bar, according to thedesignated coordinate detected by the designated coordinate detectionmeans. The first display control means zooms the stereoscopic image,according to a position of the slider, of the second adjustment bar,which is adjusted the second adjustment bar control means.

According to the above configuration, the user adjusts the secondadjustment bar displayed on the screen by using the designatedcoordinate detection means, thereby zooming the stereoscopic imagedisplayed on the first display means.

Further, in another embodiment of the present invention, the displaycontrol program may further cause the computer to function as directiondetection means. The direction detection means detects a directioninputted by the user, based on the designated coordinate detected by thedesignated coordinate detection means. The first display control meansscrolls the stereoscopic image, based on the direction detected by thedirection detection means.

According to the above configuration, by using the designated coordinatedetection means, the direction inputted by the user can be detected.Then, the stereoscopic image can be scrolled, based on the detecteddirection. This allows the user to easily scroll the stereoscopic imageby using the designated coordinate detection means.

Further, in another embodiment of the present invention, the seconddisplay control means may set in the second display means an imagedisplay area for displaying therein the right-eye image and the left-eyeimage. In this case, a ratio of a width in an aspect ratio of the imagedisplay area is larger than a ratio of a width in an aspect ratio ofeach of the right-eye image and the left-eye image.

According to the above configuration, the width of the image displayarea can be set longer than that of each of the right-eye image and theleft-eye image. This allows the entirety of each of the right-eye imageand the left-eye image to be displayed on the screen, for example, evenwhen the respective positions of the right-eye image and the left-eyeimage are adjusted in the horizontal direction of the screen. Therefore,the user can easily adjust the stereoscopic image in the horizontaldirection.

Further, in another embodiment of the present invention, designatedcoordinate detection means for detecting a designated coordinatecorresponding to a display position on the second display means may beconnected to the display control apparatus. The display control programfurther causes the computer to function as first adjustment bar controlmeans. The first adjustment bar control means displays a firstadjustment bar having a slider configured to move in the horizontaldirection of a screen of the second display means in an area, on thescreen of the second display means, which is different from the imagedisplay area, and adjusts the slider, according to the designatedcoordinate detected by the designated coordinate detection means. Theadjustment means shifts the right-eye image and/or the left-eye image inthe horizontal direction, according to a position of the slider adjustedby the first adjustment bar control means.

According to the above configuration, the user can shift the position ofthe right-eye image and/or the position of the left-eye image by usingthe first adjustment bar. This allows the user to adjust the position ofthe right-eye image and/or the position of the left-eye image byperforming the intuitive operation, and easily adjust the appearance ofthe stereoscopic image. Furthermore, since the image display area is ascreen elongated in the horizontal direction, the user can recognize theentirety of each of the right-eye image and the left-eye image even ifthe right-eye image and/or the left-eye image are shifted in thehorizontal direction of the screen.

Further, in another embodiment of the present invention, designatedcoordinate detection means for detecting a designated coordinatecorresponding to a display position on the second display means may beconnected to the display control apparatus. The display control programfurther causes the computer to function as first adjustment bar controlmeans. The first adjustment bar control means displays on the seconddisplay means a first adjustment bar having a slider configured to movein the horizontal direction of a screen of the second display means, andadjusts a position of the slider of the first adjustment bar, accordingto the designated coordinate detected by the designated coordinatedetection means. Further, in accordance with the designated coordinatedetected by the designated coordinate detection means, the firstadjustment bar control means moves the first adjustment bar itself inthe vertical direction of the screen of the second display means withina range smaller than a range of movement of the slider. In the casewhere the slider is moved by the first adjustment bar control means inthe horizontal direction, the adjustment means shifts the position ofthe right-eye image and/or the position of the left-eye image in thehorizontal direction, according to an amount of movement of the slider.Furthermore, in the case where the first adjustment bar is moved by thefirst adjustment bar control means in the vertical direction, theadjustment means shifts the position of the right-eye image and/or theposition of the left-eye image in the vertical direction, according toan amount of movement of the first adjustment bar.

According to the above configuration, the user can shift the right-eyeimage and/or the left-eye image in the horizontal and verticaldirections by using the first adjustment bar. Also, the range ofmovement of the first adjustment bar in the vertical direction is set tobe narrow as compared to the range of movement, in the horizontaldirection, of the slider of the first adjustment bar. The right-eyeimage and/or the left-eye image are shifted in the horizontal direction,according to an amount of movement in the horizontal direction of theslider of the first adjustment bar. Also, the right-eye image and/or theleft-eye image are shifted in the vertical direction, according to theamount of movement in the vertical direction of the first adjustmentbar. Therefore, it is easy for the user to adjust the position of theright-eye image and/or the position of the left-eye image in thehorizontal direction by performing the intuitive operation. In addition,the user can make fine adjustment on the position of the right-eye imageand/or the position of the left-eye image in the vertical direction.

Further, in another embodiment of the present invention, the adjustmentmeans may be able to adjust the relative positions of the right-eyeimage and the left-eye image in the horizontal direction within a firstrange, and in the vertical direction within a second range smaller thanthe first range.

According to the above configuration, the user can adjust the positionof the right-eye image and/or the position of the left-eye image in thehorizontal direction and also in the vertical direction in a narrowerrange as compared to the horizontal direction.

Further, in another embodiment of the present invention, designatedcoordinate detection means for detecting a designated coordinatecorresponding to a display position on the second display means may beconnected to the display control apparatus. In this case, the displaycontrol program may further cause the computer to function as firstadjustment bar control means. The first adjustment bar control meansdisplays a first adjustment bar on the second display means, and adjustsa slider of the first adjustment bar, according to the designatedcoordinate detected by the designated coordinate detection means. Theadjustment means adjusts at least one of the relative positions,relative sizes and relative rotations of the right-eye image and theleft-eye image, according to a position of the slider, of the firstadjustment bar, which is adjusted by the first adjustment bar controlmeans, and stores in storage means an adjustment amount for eachstereoscopic image.

According to the above configuration, the amount of adjustment of therelative positions, relative sizes and relative rotations of theright-eye image and the left-eye image which are adjusted by the firstadjustment bar can be stored in the storage means. This allows, forexample, the adjusted image to be read and displayed by anotherapparatus, thereby displaying the adjusted stereoscopic image on theanother apparatus.

Further, in another embodiment of the present invention, the displaycontrol apparatus may include a stereo camera.

According to the above configuration, the stereoscopic image may beadjusted by using the right-eye image and the left-eye image which aretaken by the stereo camera included in the display control apparatus.

Further, in another embodiment of the present invention, the displaycontrol apparatus is a handheld display apparatus configured in onepiece of the first display means and the second display means, and thefirst display means and the second display means are joined together soas to be foldable.

According to the above configuration, the foldable handheld displayapparatus capable of displaying a stereoscopic image and a planar imagecan be provided.

Further, in another embodiment of the present invention, the displaycontrol apparatus may be detachably connected to storage means forstoring therein the right-eye image and the left-eye image.

According to the above configuration, for example, the right-eye imageand the left-eye image which are taken by another apparatus can bestored in the storage means and loaded into the display controlapparatus.

Further, in another embodiment of the present invention, the displaycontrol apparatus may include communication means capable oftransmission and reception of the right-eye image and the left-eyeimage.

According to the above configuration, for example, the right-eye imageand the left-eye image which are taken by another apparatus can beloaded into the display control apparatus by using the communicationmeans.

Further, in another embodiment of the present invention, the displaycontrol apparatus may include a slider configured to be adjustable aposition thereof in a predetermined direction. The display controlprogram further causes the computer to function as mode selection means.The mode selection means selects either of a first mode in which theright-eye image and the left-eye image, which are already taken, areused and a second mode in which the right-eye image and the left-eyeimage taken of a virtual space by means of two virtual cameras, areused. In the case where the first mode is selected by the mode selectionmeans, the first display control means displays the stereoscopic imageby using the right-eye image and the left-eye image which are alreadytaken. Also, in the case where the second mode is selected by the modeselection means, the first display control means adjusts a distancebetween the virtual cameras, according to a position of the slider, anddisplays the stereoscopic image by using the right-eye image and theleft-eye image taken of the virtual space by means of the two virtualcameras adjusted the distance therebetween.

According to the above configuration, the user can cause the displaycontrol apparatus to operate in the first mode and the second mode, andthese modes are selectable. In the first mode, the stereoscopic imagecan be displayed by using the images which are already taken. In thesecond mode, a distance between virtual cameras, which are thecomponents of the virtual stereo camera and which are present in thevirtual space, can be adjusted by using the slider. This allows the userto adjust the parallax of the virtual cameras which are the componentsof the virtual stereo camera, thereby adjusting the appearance of thestereoscopic image.

Further, in another embodiment of the present invention, the firstdisplay control means may display the stereoscopic image only in thecase where the first mode is selected by the mode selection means andwhen the slider is positioned at a predetermined position.

According to the above configuration, when the first mode is selected,the user can control displaying/not displaying of the stereoscopic imageon the first display means, according to the position of the slider.

Further, another embodiment of the present invention is a displaycontrol program executed by a computer of a display control apparatusincluding a slider configured to be adjustable a position thereof in apredetermined direction. The display control program causes the computerto function as virtual camera setting means and display control means.The virtual camera setting means sets a distance between two virtualcameras present in a virtual space, according to the position of theslider. The display control means displays a stereoscopic image ondisplay means configured to display a stereoscopically visible image, byusing a right-eye image and a left-eye image taken, in real time, of thevirtual space at the distance between the virtual cameras which is setby the virtual camera setting means.

According to the above configuration, the position of the sliderincluded in the display control apparatus is adjusted, and thereby thedistance between the two virtual cameras present in the virtual space isset. Then, the image of the virtual space is taken at the set distancebetween the virtual cameras, and the stereoscopic image is displayed onthe display means configured to display the stereoscopically visibleimage. This allows the user, for example, to adjust the appearance ofthe stereoscopic image taken of the three-dimensional game space.

Further, in another embodiment of the present invention, the presentinvention may be implemented in an embodiment of the display controlapparatus which executes the above-described display control program.Alternatively, a plurality of devices, which realize the above means,may interact with one another, thereby being configured as one displaycontrol system.

According to example embodiments of the present invention, the user canadjust the right-eye image and the left-eye image which are displayed onthe second display means, while seeing the stereoscopic image displayedon the first display means. This allows the user to easily adjust thestereoscopic effect of the stereoscopic image.

These and other objects, features, aspects and advantages of exampleembodiments of the present invention will become more apparent from thefollowing detailed description of the present invention when taken inconjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an external view of a handheld image display apparatusaccording to an embodiment of the present invention;

FIG. 2 is a diagram illustrating a lower housing 13 b viewed from a rearside thereof in a state in which an upper housing 13 a and the lowerhousing 13 b are folded;

FIG. 3 is a block diagram illustrating an internal configuration of theimage display apparatus 10;

FIG. 4 is a block diagram illustrating a functional structure of theimage display apparatus 10;

FIG. 5 is a diagram illustrating an example of images displayed onrespective screens of a stereoscopic image display device 11 and aplanar image display device 12;

FIG. 6 is a diagram illustrating a state in which a user adjusts aslider 55 of a position adjustment bar 54 by using a stick 16;

FIG. 7 is a diagram illustrating a state in which respective positionsof an object image 62 (52) and an object image 63 (53), of which theuser feels an experience, are changed depending on the adjustment of theslider 55 of a position adjustment bar 54;

FIG. 8 is a diagram illustrating a superimposed portion and anon-overlapping portion of a left-eye image 51 a and a right-eye image51 b being superimposed one on the other;

FIG. 9 is a diagram illustrating a state in which the user adjusts therespective positions of the left-eye image 51 a and the right-eye image51 b in the vertical direction by using the position adjustment bar 54;

FIG. 10 is a diagram illustrating a state in which a zoom adjustment bar56 is used for enlarging a stereoscopic image 61;

FIG. 11 is a diagram illustrating a state in which the stereoscopicimage 61 is scrolled by a touch operation;

FIG. 12 is a diagram illustrating a state in which the stereoscopicimage is adjusted by rotating or enlarging the right-eye image 51 b;

FIG. 13 is a diagram illustrating a memory map of a main memory 31 ofthe image display apparatus 10

FIG. 14 is a main flowchart illustrating in detail an image displaycontrol process according to a first embodiment;

FIG. 15 is a flowchart illustrating in detail a position adjustmentprocess (step S2);

FIG. 16 is a flowchart illustrating in detail a rotation/size changeprocess (step S3);

FIG. 17 is a flowchart illustrating in detail a zoom process (step S4);

FIG. 18 is a flowchart illustrating in detail a scrolling process (stepS5);

FIG. 19 is a diagram illustrating a state in which the left-eye image 51a and the right-eye image 51 b displayed on the planar image displaydevice 12 are zoomed or scrolled in response to performing zooming orscrolling of the stereoscopic image 61;

FIG. 20 is a diagram illustrating a memory map of a main memory 31 of animage display apparatus 10 according to a second embodiment;

FIG. 21 is a main flowchart illustrating in detail a process accordingto the second embodiment; and

FIG. 22 is a flowchart illustrating in detail a process of a first mode.

DESCRIPTION OF EXAMPLE EMBODIMENTS

(First Embodiment)

An image display apparatus according to a first embodiment of thepresent invention will be described, with reference to the accompanyingdrawings. FIG. 1 is an external view of a handheld image displayapparatus according to the embodiment of the present invention.

(Description of Image Display Apparatus)

In FIG. 1, an image display apparatus 10 includes the stereoscopic imagedisplay device 11 capable of displaying a stereoscopic image, and aplanar image display device 12 capable of displaying a two-dimensionalplanner image. A housing 13 is configured of an upper housing 13 a and alower housing 13 b. The stereoscopic image display device 11 isaccommodated in the upper housing 13 a, and the planar image displaydevice 12 is accommodated in the lower housing 13 b. The stereoscopicimage display device 11 and the planar image display device 12 each havea predetermined resolution (256 dots×192 dots, for example). Although aliquid crystal display is used as a display device in the presentembodiment, any other display device, such as a display device using anEL (Electro Luminescence), or the like may be used. In addition, adisplay device having any resolution may be used.

The stereoscopic image display device 11 is a display device capable ofdisplaying an image which is stereoscopically visible by the naked eye,and a lenticular lens type display device or a parallax barrier typedisplay device is used. In the present embodiment, the stereoscopicimage display device 11 of a parallax barrier type is used.

A touch panel 15, which is a designated coordinate detection device, ismounted on the screen of the planar image display device 12. The touchpanel 15 may be of any type such as a resistive film type, an opticaltype (infrared type), or a capacitive coupling type. In the presentembodiment, the touch panel 15 is of the resistive film type. The touchpanel 15 detects a position on the screen of the planar image displaydevice 12 in response to the user touching the screen of the planarimage display device 12 by using a stick 16. The position detected bythe touch panel 15 corresponds to the position on the screen of theplanar image display device 12. The user can designate the position onthe screen not only by the stick 16 but also by a finger. In the presentembodiment, the touch panel 15 has the same resolution (detectionaccuracy) as that of the planar image display device 12. However, theresolution of the touch panel 15 may not necessarily be the same as theresolution of the planar image display device 12.

A hardware slider 14 described below is provided on the upper housing 13a. A shutter button 17 is provided on a side surface of the lowerhousing 13 b for use in taking an object to be imaged by a stereo camera18 described below. The upper housing 13 a and the lower housing 13 bare connected via a hinge portion 19. The upper housing 13 a and thelower housing 13 b are connected to each other via the hinge portion 19so as to be openable and closable (foldable).

FIG. 2 is a diagram illustrating the lower housing 13 b viewed from arear side thereof in a state in which the upper housing 13 a and thelower housing 13 b are folded. As shown in FIG. 2, a stereo camera 18 isprovided in the rear side of the lower housing 13 b. The stereo camera18 includes a left-eye image imaging section 18 a and a right-eye imageimaging section 18 b. The distance between the left-eye image imagingsection 18 a and the right-eye image imaging section 18 b is set, forexample, to an average distance (65 mm, for example) between the leftand right human eyes. Each of the left-eye image imaging section 18 aand the right-eye image imaging section 18 b includes an imaging device,such as a CCD image sensor or a CMOS image sensor, having apredetermined resolution, and a zoom lens. The left-eye image imagingsection 18 a takes the left-eye image, and the right-eye image imagingsection 18 b takes the right-eye image. The left-eye image imagingsection 18 a and the right-eye image imaging section 18 b take theleft-eye image and the right-eye image, respectively, in response topressing the shutter button 17 by the user. The user can press theshutter button 17, while viewing the screens of the stereoscopic imagedisplay device 11 and the planar image display device 12 in a state inwhich the upper housing 13 a and the lower housing 13 b are in an openstate as shown in FIG. 1. That is, the left-eye image and the right-eyeimage, when the image of the object to be imaged is taken by the stereocamera 18, are displayed on the screen of the planar image displaydevice 12, and the then stereoscopic image is displayed on thestereoscopic image display device 11. This allows the user to take theimage of the object to be imaged, while verifying the image displayed onthe screen.

FIG. 3 is a block diagram illustrating an internal configuration of theimage display apparatus 10. As shown in FIG. 3, other componentsincluded in the image display apparatus 10 are a CPU 30, a main memory31, a ROM 32, a memory control circuit 33, a stored data memory 34, anda communication module 35. These electronic components are mounted on anelectronic circuit substrate and accommodated in the lower housing 13 b(or the upper housing 13 a).

The CPU 30 is information processing means for executing a predeterminedprogram. In the present embodiment, the predetermined program is storedin the ROM 32 of the image display apparatus 10, and a display controlprocess described below is executed by the CPU 30 executing thepredetermined program.

The main memory 31, the ROM 32, and the memory control circuit 33 areconnected to the CPU 30. The stored data memory 34 is connected to thememory control circuit 33. The main memory 31 is a readable/writablesemiconductor memory. The main memory 31 includes an area fortemporarily storing the predetermined program, areas for temporarilystoring the left-eye image and the right-eye image, and a work area anda buffer area of the CPU 30. That is, the main memory 31 stores varioustypes of data used for the display control process described below,stores the predetermined program stored in the ROM 32, and the like. TheROM 32 is a non-volatile memory and used for storing the predeterminedprogram. The stored data memory 34 is storage means for storing data ofthe images taken by the left-eye image imaging section 18 a and theright-eye image imaging section 18 b, and the like. The stored datamemory 34 is implemented as a non-volatile storage medium and, forexample, a NAND flash memory is used. The memory control circuit 33 is acircuit for controlling reading of data from the stored data memory 34or writing of data to the stored data memory 34 in accordance with aninstruction from the CPU 30.

The program executed by the CPU 30 may be stored in advance in the ROM32, may be obtained from the stored data memory 34, or may be obtainedfrom another apparatus by means of communication with the anotherapparatus via the communication module 35.

The communication module 35 has a function of performing wired orwireless communication with the another apparatus. The communicationmodule 35 has a function of performing, for example, infraredcommunication with the another apparatus. The communication module 35may have a function of connecting to a wireless LAN in a method basedon, for example, IEEE 802.11.b/g standard, or have a function ofperforming communication with the another apparatus by means of theBluetooth (registered trademark) technology. Furthermore, thecommunication module 35 may also have a function of connecting to amobile communication network by means of a communication scheme used formobile phones, and the like.

The touch panel 15 is connected to the CPU 30. The touch panel 15 isconnected to an interface circuit (not shown), and the interface circuitgenerates a predetermined form of touch position data, based on a signaloutputted from the touch panel 15, and outputs the touch position datato the CPU 30. For example, the touch position data represents acoordinate of a position, on which an input is made, on an input surfaceof the touch panel 15. The interface circuit reads a signal outputtedfrom the touch panel 15, and generates the touch position data everypredetermined time. The CPU 30 acquires the touch position data via theinterface circuit to recognize the position on which the input is madeon the touch panel.

The shutter button 17 and the imaging devices (the left-eye imageimaging section 18 a and the right-eye image imaging section 18 b) areconnected to the CPU 30. In response to pressing the shutter button 17,the CPU 30 transmits an instruction for taking images to the left-eyeimage imaging section 18 a and the right-eye image imaging section 18 b.The left-eye image imaging section 18 a and the right-eye image imagingsection 18 b take images, according to the instruction from the CPU 30,and output data of the respective taken images to the CPU 30.

The stereoscopic image display device 11 and the planar image displaydevice 12 are connected to the CPU 30. The stereoscopic image displaydevice 11 and the planar image display device 12 display images,according to respective instructions from the CPU 30. As describedabove, the stereoscopic image is displayed on the stereoscopic imagedisplay device 11, and the planar image is displayed on the planar imagedisplay device 12.

The hardware slider 14 is connected to the CPU 30. The hardware slider14 is a slide switch and adjustable at any position (or a predeterminedposition) in a horizontal direction. The hardware slider 14 outputs tothe CPU 30 a signal according to the adjusted position.

Next, a functional structure of the image display apparatus 10 will bedescribed, with reference to FIG. 4. FIG. 4 is a block diagramillustrating the functional structure of the image display apparatus 10.As shown in FIG. 4, the image display apparatus 10 includes memories 31a and 31 b, an adjustment section 40, an input control section 41, afirst display control section 42, and a first display control section43. The memories 31 a and 31 b are parts of the storage area of the mainmemory 31. The adjustment section 40, the input control section 41, thefirst display control section 42, and the second display control section43 are achieved by the CPU 30 executing the predetermined program.

The memories 31 a and 31 b temporarily store the images taken by theleft-eye image imaging section 18 a and the right-eye image imagingsection 18 b, respectively. The left-eye image taken by the left-eyeimage imaging section 18 a is stored in the memory 31 a, and theleft-eye image taken by the right-eye image imaging section 18 b isstored in memory 31 b.

According to the signal outputted from the input control section 41, theadjustment section 40 adjusts the relative positions, relative sizes,and relative rotations of the left-eye image and the right-eye imagewhen displayed on the display device. The position of each of theleft-eye image and the right-eye image is represented as a coordinatevalue (which is internally set in XY coordinate system) of the center ofthe each image. An X-axis direction in the XY coordinate systemcorresponds to the horizontal direction of the screens (of thestereoscopic image display device 11 and the planar image display device12), and a Y-axis direction corresponds to the vertical direction of thescreens. The relative positions of the left-eye image and the right-eyeimage are adjusted by changing the coordinate value of the center ofeach image in the horizontal direction (X direction) and/or the verticaldirection (Y direction). For example, the adjustment section 40 adjuststhe relative positions of the left-eye image and the right-eye image bymoving the left-eye image and/or the right-eye image in the horizontaldirection. Furthermore, the adjustment section 40 adjusts the relativesizes of the left-eye image and the right-eye image by changing the sizeof the left-eye image and/or the right-eye image. For example, theadjustment section 40 enlarges the left-eye image, thereby making thesize of the left-eye image large relative to the right-eye image.Furthermore, the adjustment section 40 rotates the left-eye image and/orthe right-eye image about the center of the image, thereby adjusting therelative rotations (angles of rotations) of the left-eye image and theright-eye image. For example, the adjustment section 40 rotates theleft-eye image by a predetermined angle, thereby adjusting the relativerotations of the left-eye image and the right-eye image.

The input control section 41 outputs to the adjustment section 40 acontrol signal, according to the position detected by the touch panel15. That is, according to the position detected by the touch panel 15,the input control section 41 detects operations on the left-eye imageand the right-eye image (such as an operation on the position adjustmentbar 54 described below (see FIG. 5), a rotation operation or anenlargement or reduction operation on the left-eye image or theright-eye image), which are performed by the user, and outputs thedetected data to the adjustment section 40 as the control signal.Furthermore, according to the position detected by the touch panel 15,the input control section 41 adjusts the position of the positionadjustment bar 54 displayed on the planar image display device 12, aposition of the slider 55 of the position adjustment bar 54, and aposition of the slider 57 of the zoom adjustment bar 56. In addition,the input control section 41 scrolls or zooms the stereoscopic imagedisplayed on the stereoscopic image display device 11, according to theposition detected by the touch panel 15 (the detail will be describedbelow).

The first display control section 42 performs a display control for thestereoscopic image display device 11. The first display control section42 displays the stereoscopic image on the stereoscopic image displaydevice 11 by synthesizing the left-eye image and the right-eye imageadjusted by the adjustment section 40. For example, if the respectivepositions of the left-eye image and the right-eye image are shifted bythe adjustment section 40 in the left-right direction by a predeterminedamount, the first display control section 42 shifts the respectivepositions of the left-eye image and the right-eye image in theleft-right direction by the predetermined amount. The first displaycontrol section 42 then synthesizes the shifted two images to generatethe stereoscopic image. For example, the first display control section42 divides each of the two shifted images into rectangle-shaped imageseach having one line of pixels aligned in the vertical direction, andalternately aligns the rectangle-shaped images of each image, therebysynthesizing the two images. The first display control section 42 thenoutputs data of the synthesized image to the stereoscopic image displaydevice 11. When viewed through the parallax barrier in the stereoscopicimage display device 11, the image is displayed such that presentationviewed only with the right eye and presentation only viewed with theleft eye are alternately displayed line by line. Therefore, theright-eye image is viewed with the right eye and the left-eye image isviewed with the user's left eye. This allows the stereoscopic image tobe displayed on the stereoscopic image display device 11. Furthermore,the first display control section 42 zooms or scrolls the stereoscopicimage displayed on the stereoscopic image display device 11, accordingto the signal outputted from the input control section 41.

The second display control section 43 performs the display control forthe planar image display device 12. The second display control section43 superimposes the left-eye image and the right-eye image one on theother, which are adjusted by the adjustment section 40, and displays aplanar image, which is obtained by the superimposition, on the planarimage display device 12. For example, if the respective positions of theleft-eye image and the right-eye image are shifted by the adjustmentsection 40 in the left-right direction by the predetermined amount, thesecond display control section 43 shifts the respective positions of theleft-eye image and the right-eye image in the left-right direction bythe predetermined amount. The second display control section 43 thenmakes the shifted two images semi-transparent and superimposes one onthe other, and displays a resulting superimposed image on the planarimage display device 12 in a planar manner. Therefore, the user can viewboth the left-eye image and the right-eye image, and easily recognize anextent of how much the left-eye image and the right-eye image areshifted. Also, the second display control section 43 controls thedisplay of each of the position adjustment bar 54 and the zoomadjustment bar 56, based on the signal outputted from the input controlsection 41.

(Adjustment Operation on Stereoscopic Image)

Next, the adjustment of the stereoscopic image will be described, withreference to FIG. 5 to FIG. 12. FIG. 5 is a diagram illustrating anexample of images displayed on the screens of the stereoscopic imagedisplay device 11 and the planar image display device 12. In FIG. 5 toFIG. 12, components irrelevant to the present invention is omitted andadditionally, the screens of the stereoscopic image display device 11and the planar image display device 12 are represented relatively largein size as compared to the actual sizes.

As shown in FIG. 5, the image display region 50 is provided in thescreen of the planar image display device 12. A left-eye image 51 a anda right-eye image 51 b are displayed in the image display region 50. Asshown in FIG. 5, a ratio of the width of the image display region 50 inan aspect ratio (a ratio of the length in the horizontal direction(width) to the length in the vertical direction (height)) is greaterthan a ratio of the width of the left-eye image 51 a to the right-eyeimage 51 b in the aspect ratio. That is, the image display region 50 isan area horizontally longer than the width of each of the left-eye image51 a and the right-eye image 51 b.

The left-eye image 51 a is an image taken by the left-eye image imagingsection 18 a. An object image 52 a and an object image 53 a are includedin the left-eye image 51 a. The object image 52 a and the object image53 a are images obtained by the left-eye image imaging section 18 ataking images of the objects to be imaged 52 and 53 which exist inactual space. Also, the right-eye image 51 b is an image taken by theright-eye image imaging section 18 b, and the object image 52 b and theobject image 53 b are included in the right-eye image 51 b. The objectimage 52 b and the object image 53 b are images obtained by taking theimages of the objects to be imaged 52 and 53, which exist in actualspace, by the right-eye image imaging section 18 b. That is, the objectimage 52 a and the object image 52 b are images taken of the same theobject to be imaged 52. However, the left-eye image 51 a and theright-eye image 51 b have parallax therebetween, and therefore theobject image 52 a and the object image 52 b are not exactly the sameimages as each other. Similarly, although the object image 53 a and theobject image 53 b are images taken of the same object to be imaged 53,the left-eye image 51 a and the right-eye image 51 b has parallax, andtherefore the object image 53 a and the object image 53 b are notexactly the same images as each other.

As shown in FIG. 5, the left-eye image 51 a and the right-eye image 51 bdisplayed on the screen the planar image display device 12 are madesemi-transparent and superimposed one on the other for display. Theposition adjustment bar 54 and the slider 55 are displayed on the screenof the planar image display device 12. The zoom adjustment bar 56 andthe slider 57 are also displayed on the screen of the planar imagedisplay device 12.

On the other hand, the stereoscopic image 61 is displayed on the screenof the stereoscopic image display device 11. The stereoscopic image 61is the image obtained by synthesizing the left-eye image 51 a and theright-eye image 51 b. The stereoscopic image 61 is stereoscopicallyvisible when seen by the user. The object image 62 and the object image63 are included in the stereoscopic image 61. The object image 62 is animage taken of the object to be imaged 52, which exists in actual space,and an image stereoscopically visible to the user, as shown in FIG. 5.The object image 62 is an image obtained by synthesizing the objectimage 52 a of the left-eye image 51 a with the object image 52 b of theright-eye image 51 b. Similarly, the object image 63 is an image takenof the object to be imaged 53, which exists in actual space, and animage stereoscopically visible to the user, as shown in FIG. 5. Theobject image 63 is an image obtained by synthesizing the object image 53a of the left-eye image 51 a with the object image 53 b of the right-eyeimage 51 b.

The position adjustment bar 54 is a user interface for the user toadjust the respective positions of the left-eye image 51 a and theright-eye image 51 b in the horizontal direction and the verticaldirection of the screen. The user slides the slider 55 of the positionadjustment bar 54 in the horizontal direction, while touching the slider55 by using the stick 16, thereby adjusting an amount of shift (therelative positions) of the left-eye image 51 a and the right-eye image51 b in the horizontal direction. Also, the user touches thepredetermined position of the position adjustment bar 54 by using thestick 16 to move the slider 55 to the touch position, thereby adjustingthe amount of shift (the relative positions) of the left-eye image 51 aand the right-eye image 51 b in the horizontal direction. Thisadjustment changes the stereoscopic effect of the stereoscopic imagedisplayed on the stereoscopic image display device 11 and the detailthereof will be described below.

In FIG. 5, the left-eye image 51 a and the right-eye image 51 b aredisplayed being shifted in the up-down and the left-right directions forthe purpose of explanation and, in fact, the respective positions of theleft-eye image 51 a and the right-eye image 51 b coincide with eachother (the center of the left-eye image 51 a coincides with the centerof the left-eye image 51 a). However, the position of the object image52 a included in the left-eye image 51 a differs from the position ofthe object image 52 b included in the right-eye image 51 b.Specifically, when the two images are made semi-transparent andsuperimposed one on the other, the object image 52 a included in theleft-eye image 51 a is shifted rightward, as compared to the objectimage 52 b included in the right-eye image 51 b. That is, the objectimage 52 a included in the left-eye image 51 a is positioned relativelyrightward, and the object image 52 b included in the right-eye image 51b is positioned relatively leftward. Therefore, the object image 62displayed on the stereoscopic image display device 11 appears to bepositioned closer to the user than the screen of the stereoscopic imagedisplay device 11 (see FIG. 7 described below) is. The object image 53 aincluded in the left-eye image 51 a is further shifted rightward, ascompared to the object image 53 b included in the right-eye image 51 b.That is, the object image 53 a included in the left-eye image 51 a isshifted rightward, and the object image 53 b included in the right-eyeimage 51 b is shifted leftward. The amount of shift of the object image53 a and the object image 53 b is larger than the amount of shift of theobject image 52 a and the object image 52 b. Therefore, the object image63 displayed on the stereoscopic image display device 11 appears to bepositioned even closer to the user than the object image 62 (see FIG. 7described below) is.

Next, the adjustment of the left-eye image 51 a and the right-eye image51 b in the horizontal direction will be described, with reference toFIG. 6. FIG. 6 is a diagram illustrating a state in which the useradjusts the slider 55 of the position adjustment bar by using the stick16. In FIG. 6, a slider 55′, which is indicated by a dotted line, is theslider 55 prior to adjustment (being moved in the right direction of thescreen) by the user, and the slider 55, which is indicated by a solidline, is after the adjustment by the user. In accordance with the slider55 being moved from a position P1 to a position P2, the left-eye image51 a and the right-eye image 51 b displayed in the image display region50 of the planar image display device 12 each move in the horizontaldirection of the screen. Specifically, the left-eye image 51 a moves inthe leftward direction of the screen, and the right-eye image 51 b movesin the rightward direction of the screen. That is, when the slider 55 ofthe position adjustment bar 54 moves in the horizontal direction, theleft-eye image 51 a and the right-eye image 51 b move away from eachother (shift) in the horizontal direction by an amount according to anamount of movement of the slider 55, and therefore the amount of shiftof the left-eye image 51 a and the right-eye image 51 b changes. Theamount of shift of the left-eye image 51 a and the right-eye image 51 bmay be changed by either of the left-eye image 51 a and the right-eyeimage 51 b moving according to the amount of movement of the slider 55.

When the slider 55 of the position adjustment bar 54 is positioned at apredetermined position (the center of a range of movement, for example),the amount of shift of the left-eye image 51 a and the right-eye image51 b becomes zero (the position at the center of the left-eye image 51 acoincides with the position at the center of the right-eye image 51 b).For example, in accordance with the slider 55 being slid rightward fromthe center, the amount of shift between the images becomes large suchthat the left-eye image 51 a moves leftward and the right-eye image 51 bmoves rightward. This allows the object image 62 and the object image 63displayed on the stereoscopic image display device 11 to appear tomoving in the depth direction of the screen, as described below. Oncontrary, in accordance with the slider 55 being slid leftward from thecenter, an absolute value of the amount of shift between the imagesbecomes large such that the left-eye image 51 a moves rightward and theright-eye image 51 b moves leftward (a value of the amount of shift inthis case becomes negative). This allows the object image 62 and theobject image 63 displayed on the stereoscopic image display device 11 toappear to moving in the frontward direction of the screen, as describedbelow.

On the other hand, the stereoscopic image 61 displayed on the screen ofthe stereoscopic image display device 11 also changes according to themovement of the slider 55. When the slider 55 moves, the respectivepositions in the horizontal direction of the left-eye image 51 a viewedwith the user's left eye and the right-eye image 51 b viewed with theuser's right eye, which are displayed on the screen of the stereoscopicimage display device 11, also change. That is, in similar to theleft-eye image 51 a and the right-eye image 51 b displayed on the planarimage display device 12, the left-eye image 51 a and the right-eye image51 b displayed on the stereoscopic image display device 11 also move inthe horizontal direction by the amount according to the amount ofmovement of the slider 55. As a result, when the user views thestereoscopic image 61 after the slider 55 has moved (the position P2),the object image 62 and the object image 63 included in the stereoscopicimage 61 appear to be positioned in the depth direction of the screen,as compared to before the slider 55 moves (the position P1). That is,the movement of the slider 55 causes the object image 62 and the objectimage 63 included in the stereoscopic image 61 to appear to have movedin the depth direction of the screen.

FIG. 7 is a diagram illustrating a state in which the respectivepositions of the object image 62 (52) and the object image 63 (53), ofwhich the user feels an experience, are changed depending on theadjustment of the slider 55 of the position adjustment bar 54. FIG. 7 isthe diagram illustrating the user, the stereoscopic image display device11, and the objects to be imaged 52 and 53 (the object image 62 and 63)viewed from the above, and illustrates the positional relationshipthereof felt by the user as an experience. Before the slider 55 moves,the user feels an experience as if the object image 62 and the objectimage 63 are positioned in front of the screen of the stereoscopic imagedisplay device 11 (closer to the user side than the screen is) (appearto be positioned at positions 62′ and 63′, respectively). Morespecifically, in similar to the positional relationship between theobject to be imaged 52 and the object to be imaged 53, which exist inactual space, the user feels an experience as if the object image 63′exists at a position in the frontward direction of the screen (aposition closer to the user), as compared to the object image 62′. Onthe other hand, in accordance with the movement of the slider 55, itappears to the user as if the object image 62 and the object image 63move in the depth direction (a direction perpendicular to the screen,and the viewing direction of the user) of the screen of the stereoscopicimage display device 11 (in other words, it appears as if the screen ofthe stereoscopic image display device 11 moves toward the user). Morespecifically, after the slider 55 has moved, the user feels anexperience as if the object image 62 is positioned in the depthdirection of the screen, and the object image 63 is positioned near thescreen. As described above, when the user moves the slider 55 in theright direction of the screen of the planar image display device 12, itappears as if the object image 62 (and 63) included in the stereoscopicimage 61 has moved in the depth direction of the screen of thestereoscopic image display device 11 (as if moves away in the depthdirection of the screen). On contrary, when the user moves the slider 55in the left direction, it appears as if the object image 62 (and 63)included in the stereoscopic image 61 has moved in the frontwarddirection of the screen (to jump out from the screen). That is, when theuser adjusts the slider 55 of the position adjustment bar 54 in thehorizontal direction, it appears to the user as if the position of theobject to be imaged included in the stereoscopic image 61 has changed.Therefore, the user can change the appearance of the stereoscopic image61 by moving the slider 55 of the position adjustment bar 54 in thehorizontal direction.

Furthermore, by moving the slider 55 of the position adjustment bar 54in the horizontal direction, the user can display a desired object to beimaged included in the stereoscopic image 61 so as to be easily seen bythe user. For example, as shown by the dotted line in FIG. 7, before theslider 55 is moved, the position of the object image 63 which is viewedby the user is frontward to the screen and the position (position 63′)spaced a predetermined distance away from the screen. On the other hand,the position of the object image 62 which is viewed by the user isfrontward to and near the screen (position 62′). In this case, it iseasy for the user to view the object image 62 stereoscopically, butdifficult for the user to view the object image 63 stereoscopically.This is because the image is displayed actually on the screen and thus,the user focuses the eyes on the screen to see the image. The objectimage 62′ prior to movement, which is viewed near the screen, is easilyviewed stereoscopically, because the position recognized by the user inthe direction perpendicular to the screen is near the position on whichthe eyes are focused. On the other hand, the object image 63′ prior tomovement is poorly viewed stereoscopically because the positionrecognized by the user in the direction perpendicular to the screen isdifferent from the position on which the eyes are focused (if the objectimage 63′ prior to movement is seen when the eyes are focused on thescreen, the image appears blurred or is unrecognizablestereoscopically). In this case, the user moves the slider 55 in thehorizontal direction, and thereby moves the object image 63 in the depthdirection of the screen, and moves the object image 63 to near thescreen. Therefore, by moving the slider 55 in the horizontal direction,the user can display the desired object to be imaged (the object image63) included in the stereoscopic image 61 so as to be easily seen by theuser.

The stereoscopic image 61 after the adjustment of the amount of shift(the position) thereof in the horizontal direction as shown in FIG. 6becomes such as the stereoscopic image 61 shown in FIG. 5 in which theboth sides of the stereoscopic image 61 prior to adjustment are cut off(see FIG. 6). Therefore, part of the object image 62 shown in FIG. 6 isnot displayed. This is because the left-eye image 51 a and the right-eyeimage 51 b are shifted in the horizontal direction, and which has causednon-overlapping portion of the two images, respectively. If thestereoscopic image including the portions of the left-eye image 51 a andthe right-eye image 51 b, which are not superimposed (non-overlappingarea) one on the other, is displayed on the stereoscopic image displaydevice 11, part of the stereoscopic image becomes an image having thestereoscopic effect, while the other part becomes an image having nostereoscopic effect, and which is a state in which “what should bevisible is invisible” or “what should be invisible is visible” for theviewer. Therefore, the image, as a whole, ends up causing a sense ofdiscomfort for the user. Therefore, merely the respective positions ofthe left-eye image 51 a and the right-eye image 51 b, which aresuperimposed (superimposing area) one on the other, are synthesized anddisplayed on the screen of the stereoscopic image display device 11.

Here, the “superimposing area” and the “non-overlapping area” of the twoimages will be described, with reference to FIG. 8. FIG. 8 is a diagramillustrating the superimposed portion and non-overlapping portion of theleft-eye image 51 a and the right-eye image 51 b being superimposed oneon the other. As shown in FIG. 8, the object images 52 a, 53 a, and 58 aare included in the left-eye image 51 a. Similarly, the object images 52b, 53 b, and 58 b are included in the right-eye image 51 b. Shiftingthese two images in the horizontal direction and superimposing one onthe other cause the superimposed portion and the non-overlapping portion(non-overlapping area) of the two images (superimposing area). Thesuperimposed portion is indicated by an area R of the superimposedimage, which is surrounded by the dotted line. The non-overlappingportion is an area other than the area R of the superimposed image.Merely the area R is displayed on the screen of the stereoscopic imagedisplay device 11. In this case, when the user sees the screen of thestereoscopic image display device 11, the user can view the object image58 a with the left eye, and view the object image 58 b with the righteye. As a result, the user can recognize the object image 58stereoscopically. The object image 53 b included in the right-eye image51 b is included in the area R, and therefore displayed on the screen ofthe stereoscopic image display device 11. On the other hand, the objectimage 53 a included in the left-eye image 51 a is not included in thearea R, therefore not displayed on the screen of the stereoscopic imagedisplay device 11. Therefore, when the user sees the screen of thestereoscopic image display device 11, the user cannot view the objectimage 53 a with the left eye, and can view the object image 53 b withthe right eye. This is a natural appearance for the user. That is, evenwhen the user sees the actual space, there is the parallax between theright eye and the left eye and therefore, a certain object may be seensolely with one eye. For example, in the case where the user sees theoutside view from a window, for example, there are portions of theobject which cannot be seen with the right eye, but can be seen with theleft eye, depending on a window frame. However, if the non-overlappingportion is included and displayed on the screen, portions (53 a of FIG.8) invisible to the user's eye (the left eye in the example shown inFIG. 8) becomes visible, thus causing the sense of discomfort for theuser. Therefore, merely the superimposed portion is displayed on thestereoscopic image display device 11, thereby displaying the image whichcauses no sense of discomfort for the user.

On the other hand, the entirety of the left-eye image 51 a and theentirety of the right-eye image 51 b are displayed in the image displayregion 50 of the planar image display device 12 prior to and after theadjustment. More specifically, the superimposed portion and thenon-overlapping portion of the left-eye image 51 a and the right-eyeimage 51 b are displayed in the image display region 50 of the planarimage display device 12. As described above, in the stereoscopic imagedisplay device 11, merely the superimposed portion of the two images isdisplayed so as to make the stereoscopic image cause no sense ofdiscomfort for the user. On the other hand, the left-eye image 51 a andthe right-eye image 51 b displayed on the planar image display device 12are viewed by both eyes of the user, and therefore the user canrecognize the two images as different images. Therefore, even if thenon-overlapping portion of the two images is displayed in addition tothe superimposed portion, the image causes no sense of discomfort forthe user. Rather, when the non-overlapping portion is included anddisplayed, the user can recognize the two images as different images,thereby allowing the easy recognition of the positional relationship ofthe two images. Therefore, the user can easily recognize the position ofthe object image included in the two images. Furthermore, because thenon-overlapping portion is included and displayed on the planar imagedisplay device 12, the user can view an object to be imaged (this objectto be imaged is not displayed on the stereoscopic image display device11, or, even if displayed on the stereoscopic image display device 11,viewed with merely one eye of the user), which exists in thenon-overlapping portion. For example, the object image 53 a shown inFIG. 8, which is included in the left-eye image 51 a, exists in thenon-overlapping portion, and is not viewed with the user's left eye. Inthe case where the left-eye image 51 a is moved in order to allow suchobject image 53 a to be viewed with the user's left eye, it is difficultfor the user to make adjustment, while seeing the stereoscopic image 61displayed on the stereoscopic image display device 11. That is, theobject image 53 a is not displayed on the stereoscopic image displaydevice 11, and therefore the user cannot recognize the position of theobject image 53 a. However, the non-overlapping portion is alsodisplayed on the planar image display device 12, and therefore the usercan adjust the position of the object image 53 a, while viewing theobject image 53 a included in the non-overlapping portion. Therefore,the user can adjust the position of the object to be imaged which existsin the non-overlapping portion, and easily display the desired object tobe imaged stereoscopically.

Furthermore, the user can adjust the respective positions of theleft-eye image 51 a and the right-eye image 51 b, while seeing thestereoscopic image 61 displayed on the stereoscopic image display device11, and therefore the user can easily adjust the stereoscopic image. Asdescribed above, when the user sees the stereoscopic image 61 displayedon the stereoscopic image display device 11, it may be difficult for theuser to stereoscopically view the object image 63′ shown in FIG. 7. Ifthe user cannot view the object image 63′ stereoscopically, it isdifficult to determine the direction in which the left-eye image 51 aand the right-eye image 51 b should be adjusted by merely seeing thestereoscopic image display device 11 (determination of a position, towhich the object image 63′ should be moved in the directionperpendicular to the screen, cannot be made). On the other hand, theleft-eye image 51 a and the right-eye image 51 b are madesemi-transparent and superimposed one on the other, and displayed on theplanar image display device 12. This allows the user to easily recognizehow far the object images 53 a and 53 b, which are included in the twoimages, are apart from each other, by seeing the planar image displaydevice 12. Therefore, the user may adjust the respective positions ofthe left-eye image 51 a and the right-eye image 51 b so as to make theobject images 53 a and 53 b closer to each other (so that the objectimages 53 a and 53 b are superimposed one on the other), while seeingthe left-eye image 51 a and the right-eye image 51 b displayed on theplanar image display device 12.

Furthermore, the user can adjust the respective positions (the amount ofshift in the horizontal direction) of the left-eye image 51 a and theright-eye image 51 b, while viewing the entirety of both the left-eyeimage 51 a and the right-eye image 51 b (the entirety of the imageincluding the superimposed portion and the non-overlapping portion).Therefore, the positional relationship of the two images is easilyrecognizable to the user, thereby being adjusted easily. The user caneasily adjust the two images, for example, even in the case where theuser adjusts the two images to view a certain object to be imagedstereoscopically, and thereafter adjusts the two images to view anotherobject to be imaged stereoscopically. That is, the entirety of both theleft-eye image 51 a and the right-eye image 51 b are displayed on theplanar image display device 12 and thus, even after the respectivepositions of the two images are adjusted, the positional relationship ofthe two images can be easily recognized. Therefore, the two images areeasily adjusted.

As described above, the slider 55 of the position adjustment bar 54 ismoved in the horizontal direction, and thereby the images displayed onthe stereoscopic image display device 11 and the planar image displaydevice 12 change. Specifically, by adjusting the respective positions ofthe left-eye image 51 a and the right-eye image 51 b in the horizontaldirection, the user can display the object to be imaged, which isincluded in the stereoscopic image, so that the object to be imaged ismoved in the direction perpendicular to the screen. This allows the userto adjust the respective positions of the left-eye image 51 a and theright-eye image 51 b displayed on the planar image display device 12,while seeing the stereoscopic image 61 displayed on the stereoscopicimage display device 11. Therefore, the user can easily adjust theappearance of the stereoscopic image.

Next, the adjustment of the respective positions of the left-eye image51 a and the right-eye image 51 b in the vertical direction will bedescribed, with reference to FIG. 9. FIG. 9 is a diagram illustrating astate in which the user adjusts the respective positions of the left-eyeimage 51 a and the right-eye image 51 b in the vertical direction byusing the position adjustment bar 54.

As shown in FIG. 9, if the user moves the stick 16 in the upwarddirection of the screen of the planar image display device 12 by usingthe stick 16, while touching the position adjustment bar 54 by using thestick 16, the position adjustment bar 54 also moves in the upwarddirection, according to the movement of the touch position. The positionadjustment bar 54 can be moved in the vertical direction (the up-downdirections) of the screen, the range of movement (a range in which theposition adjustment bar 54 moves) of the position adjustment bar 54 ispreviously determined. The range of movement of the position adjustmentbar 54 in the vertical direction is set smaller than the range ofmovement of the slider 55 of the position adjustment bar 54 in thehorizontal direction.

When the position adjustment bar 54 moves in the vertical direction, theleft-eye image 51 a and/or the right-eye image 51 b displayed in theimage display region 50 of the planar image display device 12 also movein the vertical direction (the up-down directions). For example, whenthe position adjustment bar 54 is moved in the upward direction of thescreen, the left-eye image 51 a (or the right-eye image 51 b) also movesin the upward direction of the screen, according to an amount ofmovement of the position adjustment bar 54 in the upward direction.According to the movement of the position adjustment bar 54 in thevertical direction, the left-eye image 51 a and the right-eye image 51 bdisplayed on the image display region 50 may be moved away from eachother in the vertical direction, or merely an image selected by thestick 16 may be moved in the vertical direction.

On the other hand, according to the movement the position adjustment bar54 in the vertical direction, the appearance of the stereoscopic image61 displayed on the screen of the stereoscopic image display device 11also changes. For example, if the left-eye image 51 a and the right-eyeimage 51 b are shifted from each other to a large extent in the verticaldirection of the screen, and when the user sees the object image 62included in the stereoscopic image 61, the object image 62 may appeardifferent in shape, as compared to the actual object to be imaged 52, orappear poorly visible as stereoscopic image. However, the easy-to-seeimage which exerts the stereoscopic effect on the user can be displayedon the stereoscopic image display device 11 by the user adjusting theamount of the shift of the left-eye image 51 a and the right-eye image51 b in the vertical direction.

As described above, by moving the position adjustment bar 54 in thevertical direction (the up-down directions) of the screen of the planarimage display device 12, the amount of shift of the respective positionsof the left-eye image 51 a and the right-eye image 51 b in the verticaldirection can be adjusted. The amount of shift in the vertical directionis caused by the amount of shift of the physical positions between theleft-eye image imaging section 18 a and the right-eye image imagingsection 18 b. For example, if the left-eye image imaging section 18 a isslightly deviated (deviated in the upward direction as compared to theleft-eye image imaging section 18 a shown in FIG. 2) in the verticaldirection, as compared to the right-eye image imaging section 18 bbecause of error in manufacturing, images deviated from each other inthe vertical direction are taken. The user can adjust such amount ofdeviation between the left-eye image 51 a and the right-eye image 51 bin the vertical direction by using the position adjustment bar 54.

Normally, the deviation between the left-eye image 51 a and theright-eye image 51 b in the vertical direction is slight and thus, theuser makes merely fine adjustment in the vertical direction. On theother hand, the user moves the object to be imaged, which is included inthe stereoscopic image, in the depth direction or the frontwarddirection of the screen, and thus adjusts the amount of shift and theleft-eye image 51 a and the right-eye image 51 b in the horizontaldirection by sliding the slider 55 in the horizontal direction. That is,normally, the amount of adjustment in the vertical direction is smallerthan the amount of adjustment in the horizontal direction. Therefore, inthe present embodiment, the range of movement of the position adjustmentbar 54 in the vertical direction is set smaller than the range ofmovement of the slider 55 of the position adjustment bar 54 in thehorizontal direction. Therefore, the user can easily adjust the amountof shift of the left-eye image 51 a and the right-eye image 51 b in thehorizontal direction, and easily make the fine adjustment in thevertical direction. That is, the slider 55 has large range of movementin the horizontal direction, and the position adjustment bar 54 hassmall range of movement in the vertical direction, and therefore theuser can make adjustment in the horizontal direction to the largeextent, and make merely fine adjustment in the vertical direction.Moreover, the slider 55 is slid in the horizontal direction for theadjustment in the horizontal direction, and the position adjustment bar54 is moved in the vertical direction for the adjustment in the verticaldirection, and therefore such operations are said to be intuitive andfriendly operations for the user. The adjustment of the left-eye image51 a and the right-eye image 51 b in the vertical direction may be madeby a slider of an adjustment slider different from the positionadjustment bar 54.

Next, a zoom operation will be described, with reference to FIG. 10.FIG. 10 is a diagram illustrating a state in which the stereoscopicimage 61 is enlarged by using the zoom adjustment bar 56. As shown inFIG. 10, when the user moves the stick 16 in the rightward direction ofthe screen of the planar image display device 12, while touching theslider 57 of the zoom adjustment bar 56 by using the stick 16, theslider 57 moves in the rightward direction. 57′ indicates the slider 57prior to movement, and 57 indicates the slider 57 after the movement.The stereoscopic image 61 displayed on the stereoscopic image displaydevice 11 is enlarged according to the movement of the slider 57. InFIG. 10, the stereoscopic image 61 is enlarged and thus, the objectimages 62 and 63, which are included in the stereoscopic image 61, arealso enlarged. Since the stereoscopic image 61 is enlarged larger thanthe screen of the stereoscopic image display device 11, merely a portionthereof is displayed.

On the other hand, the left-eye image 51 a and the right-eye image 51 bdisplayed on the planar image display device 12 are not enlargedaccording to the movement of the slider 57. A stereoscopic image displayframe 59 shown by the dotted line in FIG. 10 is displayed in the imagedisplay region 50 of the planar image display device 12. Thestereoscopic image display frame 59 indicates an area corresponding tothe area in which the stereoscopic image is displayed on thestereoscopic image display device 11. As described above, even thoughthe stereoscopic image displayed on the stereoscopic image displaydevice 11 is enlarged, the left-eye image 51 a and the right-eye image51 b displayed on the planar image display device 12 are not enlarged,but the entirety thereof are displayed. Therefore, even when thestereoscopic image is enlarged, the respective positions of the left-eyeimage 51 a and the right-eye image 51 b is easily adjusted (theadjustment of the respective positions in the horizontal direction andthe vertical direction by using the position adjustment bar 54). Thatis, the entirety of the left-eye image 51 a and the entirety of theright-eye image 51 b are displayed on the planar image display device12, and thereby the user can easily understand the positionalrelationship of these images.

Next, a scrolling operation will be described, with reference to FIG.11. FIG. 11 is a diagram illustrating a state in which the stereoscopicimage 61 is scrolled by a touch operation. As shown in FIG. 11, when theuser moves on the screen the left-eye image 51 a or the right-eye image51 b, which are displayed on the planar image display device 12, whiletouching the left-eye image 51 a or the right-eye image 51 b by usingthe stick 16, the stereoscopic image 61 on the stereoscopic imagedisplay device 11 is scrolled. For example, when the user moves theleft-eye image 51 a or the right-eye image 51 b in the leftwarddirection, while touching the left-eye image 51 a or the right-eye image51 b by using the stick 16, the stereoscopic image 61 is scrolled in therightward direction (the object image 62 included in the stereoscopicimage 61 moves in the leftward direction). On the screen of thestereoscopic image display device 11 shown in FIG. 11, an image afterthe stereoscopic image 61 is scrolled is displayed. Since thestereoscopic image 61 is scrolled in the rightward direction, the objectimage 62 included in the stereoscopic image 61 moves leftward relativeto the center of the screen, and a portion of the object image 63 is notdisplayed. By performing the scrolling operation, the user can scrollthe stereoscopic image 61 in any direction of the screen.

On the other hand, the left-eye image 51 a and the right-eye image 51 bdisplayed on the planar image display device 12 are not scrolled by theabove-described scrolling operation (the operation of moving the imagesin the right direction of the screen, while touching the images) by theuser. The stereoscopic image display frame 59 is displayed in the imagedisplay region 50 of the planar image display device 12. As describedabove, even though the stereoscopic image displayed on the stereoscopicimage display device 11 is scrolled, the left-eye image 51 a and theright-eye image 51 b displayed on the planar image display device 12 arenot scrolled. Therefore, the adjustment of the respective positions ofthe left-eye image 51 a and the right-eye image 51 b (the adjustment ofthe respective positions in the horizontal direction and the verticaldirection by use of the position adjustment bar 54) is easy. That is,the entirety of the left-eye image 51 a and the entirety of theright-eye image 51 b are displayed on the planar image display device12, and thereby the user can easily understand the positionalrelationship of the images.

Next, rotation and change in size of the left-eye image 51 a or theright-eye image 51 b will be described, with reference to FIG. 12. FIG.12 is a diagram illustrating a state in which the stereoscopic image isadjusted by rotating or enlarging the right-eye image 51 b. When theuser moves, by using the stick 16, the predetermined position of theleft-eye image 51 a or the right-eye image 51 b displayed on the planarimage display device 12, while touching the left-eye image 51 a or theright-eye image 51 b, the left-eye image 51 a or the right-eye image 51b rotates. For example, as shown in FIG. 12, when the user performs anoperation so as to rotate the right-eye image 51 b, while touching avertex V1 of the right-eye image 51 b (moves the stick 16 in a directionindicated by an arrow A shown in FIG. 12), the right-eye image 51 brotates. Furthermore, for example, when the user moves the stick 16 in adiagonal direction of the right-eye image 51 b (moves the stick 16 in adirection indicated by an arrow B shown in FIG. 12), while touching thevertex V1 of the right-eye image 51 b, the right-eye image 51 benlarges.

On the other hand, in accordance with the rotation or enlargement of theright-eye image 51 b, the appearance of the stereoscopic image 61displayed on the screen of the stereoscopic image display device 11 alsochanges. For example, in the case where the right-eye image 51 b isrotated by a predetermined angle relative to the left-eye image 51 a(more accurately, in the case where the object image 52 b included inthe right-eye image 51 b is rotated by the predetermined angle relativeto the object image 52 a included in the left-eye image 51 a), and whenthe user sees the object image 62 included in the stereoscopic image 61,the object image 62 may appear different in shape, as compared to theactual object to be imaged 52, or appear poorly visible as anstereoscopic image. Such rotation is likely to due to the error inmanufacturing, or the like. For example, there is a case inmanufacturing where the left-eye image imaging section 18 a is providedbeing rotated by a predetermined angle. Therefore, the user can adjustthe relative angle of rotation of the left-eye image 51 a and theright-eye image 51 b by rotating the left-eye image 51 a or theright-eye image 51 b. This allows the user to display on thestereoscopic image display device 11 an easy-to-see image which exertsthe stereoscopic effect on the user.

Also, if the right-eye image 51 b is small as compared to the left-eyeimage 51 a, (more accurately, the object image 52 b included in theright-eye image 51 b is smaller than the object image 52 a included inthe left-eye image 51 a) for example, and when the user sees the objectimage 62 included in the stereoscopic image 61, the object image 62 mayappear different in shape, as compared to the actual object to be imaged52, or appear poorly visible as an stereoscopic image. Such differencein size may be caused by a state during imaging (for example, differencein an operation of a zoom mechanism between the left-eye image imagingsection 18 a and the right-eye image imaging section 18 b). The user canadjust the relative sizes of the left-eye image 51 a and the right-eyeimage 51 b by enlarging or reducing the left-eye image 51 a or theright-eye image 51 b by the above-described operation. This allows theuser to display on the stereoscopic image display device 11 theeasy-to-see image which exerts the stereoscopic effect on the user.

(Details of Image Display Control Process)

Next, an image display control process according to the presentembodiment will be described in detail, with reference to FIG. 13 toFIG. 18. Initially, main data which is stored in the main memory 31during the image display control process will be described. FIG. 13 is adiagram illustrating a memory map of the main memory 31 of the imagedisplay apparatus 10. As shown in FIG. 13, a data storage area 70 isprovided in the main memory 31. The data storage area 70 stores thereinleft-eye image position data 71, right-eye image position data 72,current touch position data 73, immediately preceding touch positiondata 74, position adjustment data 75, zoom adjustment data 76,stereoscopic image display frame data 77, and the like. Other datastored in the main memory 31 are a program for executing the imagedisplay control process, left-eye image data, right-eye image data,image data of the position adjustment bar, image data of the zoomadjustment bar, and the like.

The left-eye image position data 71 is data indicative of a displayposition of the left-eye image 51 a, indicating a coordinate value ofthe center of the left-eye image 51 a. The right-eye image position data72 is data indicative of a display position of the right-eye image 51 b,indicating a coordinate value of the center of the right-eye image 51 b.

The current touch position data 73 is data indicative of a coordinatevalue, which is detected by the touch panel 15 in a current frame, ofthe touch position. If the touch position is not detected in the currentframe, a value, which indicates that the touch position is not detected,is stored in the current touch position data 73. The immediatelypreceding touch position data 74 is data indicative of a coordinatevalue detected by the touch panel 15 in an immediately preceding frame.If the touch position is not detected in the immediately precedingframe, a value, which indicates that the touch position is not detected,is stored in the immediately preceding touch position data 74.

The position adjustment data 75 is data regarding the positionadjustment bar 54. Specifically, the position adjustment data 75includes data indicative of a coordinate value of a display position ofthe position adjustment bar 54, and data indicative of the position ofthe slider 55 on the position adjustment bar 54.

The zoom adjustment data 76 is data regarding the zoom adjustment bar56, indicative of the position of the slider 57 on the zoom adjustmentbar 56.

The stereoscopic image display frame data 77 is data indicative of theposition and size of the stereoscopic image display frame 59 displayedon the planar image display device 12.

Next, the image display control process will be described in detail,with reference to FIG. 14. FIG. 14 is a main flowchart illustrating indetail the image display control process according to the firstembodiment. When the image display apparatus 10 is powered on, the CPU30 of the image display apparatus 10 executes a boot program stored inthe ROM 32 to initialize each unit, such as the main memory 31. Next,the main memory 31 reads the image display control program stored in theROM 32, and the CPU 30 starts executing the program. The main memory 31reads the left-eye image 51 a and the right-eye image 51 b stored in thestored data memory 34. The flowchart shown in FIG. 14 is a flowchartshowing a process which is performed after the above-described processis completed. The description of processes, which does not directlyrelate to the present invention, is omitted in FIG. 14. A processingloop of step S1 through step S8 shown in FIG. 14 is repeatedly executedfor each frame (for example, 1/30 second, which is referred to as frametime).

Initially, in step S1, the CPU 30 detects that a touch has occurred onthe touch panel 15. If the touch has occurred on the touch panel 15, theCPU 30 stores the detected touch position in the main memory 31 as thecurrent touch position data 73, and next executes a process of step S2.On the other hand, if the touch has not occurred on the touch panel 15,the CPU 30 stores in the main memory 31 the value which indicates thatthe touch position has not been detected as the current touch positiondata 73, and next executes a process of step S6.

In step S2, the CPU 30 executes a position adjustment process. In stepS2, the CPU 30 adjusts the respective positions of the left-eye image 51a and the right-eye image 51 b, based on the detected touch position.The position adjustment process in step S2 will be described in detail,with reference to FIG. 15. FIG. 15 is a flowchart showing in detail theposition adjustment process (step S2).

In step S11, the CPU 30 determines whether or not the current touchposition falls within the display area of the position adjustment bar54. Specifically, the CPU 30 refers to the current touch position data73 stored in the main memory 31 to acquire the current touch position(the touch position detected in step S1 of the current processing loop).Next, the CPU 30 refers to the position adjustment data 75 to determinewhether or not the acquired current touch position falls within thedisplay area (the area in which the position adjustment bar 54 isdisplayed on the screen of the planar image display device 12) of theposition adjustment bar 54. If the determination result is affirmative,the CPU 30 next executes a process of step S12. On the other hand, ifthe determination result is negative, the CPU 30 next executes a processof step S14.

In step S12, the CPU 30 moves the slider 55 of the position adjustmentbar 54 to the current touch position. In step S12, the slider 55 of theposition adjustment bar 54 is moved on the position adjustment bar 54 inthe horizontal direction. Specifically, the CPU 30 calculates a positionon the position adjustment bar 54, which corresponds to the currenttouch position, and stores the calculated position in the positionadjustment data 75 of the main memory 31. Next, the CPU 30 executes aprocess of step S13.

In step S13, the CPU 30 sets the amount of shift of the respectivepositions in the horizontal direction. Specifically, the CPU 30calculates the amount of shift of the left-eye image 51 a and theright-eye image 51 b in the horizontal direction (the left-right(X-axis) direction of the screen), based on the position calculated instep S12 of the slider 55 on the position adjustment bar 54, and storesthe calculated amount of shift in the main memory 31. If the slider 55is present at a position predetermined distance away from the left endof the position adjustment bar 54, the CPU 30 sets the amount of shiftin the horizontal direction, according to the predetermined distance.The amount of shift in the horizontal direction is an amount of shift (adifference in X coordinate values) of a coordinate value of the centerof the left-eye image 51 a and a coordinate value of the center of theright-eye image 51 b relative to the X axis. For example, the CPU 30sets the amount of shift in the horizontal direction as positive in astate in which the amount of shift in the horizontal direction when theslider 55 is present at a position P0 (the center position of theposition adjustment bar 54, for example) on the position adjustment bar54 is defined as 0 and if the slider 55 is present rightward relative tothe position P0. On the other hand, for example, if the slider 55 ispresent leftward relative to the position P0, the CPU 30 sets the amountof shift in the horizontal direction as negative. If the amount of shiftin the horizontal direction is positive, the left-eye image 51 a ispositioned on the left side of the screen, as compared to the right-eyeimage 51 b. If the amount of shift in the horizontal direction isnegative, the left-eye image 51 a is positioned on the right side of thescreen, as compared to the right-eye image 51 b. Next, the CPU 30 endsthe position adjustment process.

On the other hand, the CPU 30 determines in step S14 whether or not thetouch position in the immediately preceding frame falls within thedisplay area of the position adjustment bar 54. The touch position inthe immediately preceding frame refers to the touch position detected instep S1 in the processing loop immediately before the current processingloop. Specifically, the CPU 30 refers to the immediately preceding touchposition data 74 in the main memory 31 to determine whether or not theimmediately preceding touch position is present within the display areaof the position adjustment bar 54. If the determination result isaffirmative, the CPU 30 next executes a process of step S15. On theother hand, if the determination result is negative, the CPU 30 ends theposition adjustment process.

In step S15, the CPU 30 determines whether or not the current touchposition falls within the range of movement of the position adjustmentbar 54. The position adjustment bar 54 can move in the verticaldirection (the up-down directions) of the screen within a predeterminedrange. Therefore, in step S15, it is determined whether or not thecurrent touch position falls within the range of movement. If thedetermination result is affirmative, the CPU 30 next executes a processof step S16. On the other hand, if the determination result is negative,the CPU 30 ends the position adjustment process.

In step S16, the CPU 30 moves the position adjustment bar 54 to thecurrent touch position. In step S16, the position adjustment bar 54 ismoved in the vertical direction (the up-down directions) of the screen.Specifically, the CPU 30 calculates a movement vector indicative of themovement of the position adjustment bar 54 in the vertical (Y-axis)direction of the screen, based on the current touch position indicatedby the current touch position data 73. For example, the CPU 30calculates a point of intersection between the display area of theposition adjustment bar 54 and a line segment, which passes through thecurrent touch position and which is parallel to the Y axis, and the CPU30 calculates, as the movement vector, a vector extending from thecalculated point of intersection toward the current touch position. TheCPU 30 then adds the calculated movement vector to a position vectorindicative of the display position of the position adjustment bar 54,which is indicated by the position adjustment data 75, therebycalculating the position of the position adjustment bar 54. The CPU 30stores in the main memory 31 the calculated position of the positionadjustment bar 54 as the position adjustment data 75. Next, the CPU 30executes a process of step S17.

In step S17, the CPU 30 sets the amount of shift of the respectivepositions in the vertical direction. Specifically, the CPU 30 calculatesthe amount of shift of the left-eye image 51 a and the right-eye image51 b in the vertical direction (the up-down (Y-axis) direction of thescreen), based on the position calculated in step S16 of the positionadjustment bar 54, and stores the obtained amount of shift in the mainmemory 31. More specifically, the CPU 30 calculates the amount of shiftof the respective positions in the vertical direction, according to thecoordinate value of the Y axis of the position adjustment bar 54. Theamount of shift of the respective positions in the vertical direction isthe amount of shift (a difference in Y coordinate values) of thecoordinate value of the center of the left-eye image 51 a and thecoordinate value of the center of the right-eye image 51 b relative tothe Y axis. For example, the CPU 30 sets the amount of shift in thevertical direction as positive in a state in which the amount of shiftin the horizontal direction when the position adjustment bar 54 ispresent at the predetermined position (the center of the positionadjustment bar 54 in the range of movement in the vertical direction,for example) is defined as 0, and if the position adjustment bar 54 ispresent upward relative to the predetermined position. On the otherhand, for example, if the position adjustment bar 54 is present downwardrelative to the predetermined position, the CPU 30 sets the amount ofshift in the vertical direction as negative. If the amount of shift inthe vertical direction is positive, the left-eye image 51 a ispositioned on the upper side of the screen, as compared to the right-eyeimage 51 b. If the amount of shift in the vertical direction isnegative, the left-eye image 51 a is positioned on the lower side of thescreen, as compared to the right-eye image 51 b. Next, the CPU 30 endsthe position adjustment process.

Returning to FIG. 14, the CPU 30 next executes a process of step S3after the process of step S2.

In step S3, the CPU 30 executes a rotation/size change process. In stepS3, the CPU 30 rotates or changes the size of the left-eye image 51 a orthe right-eye image 51 b, based on the touch position detected in stepS1. The rotation/size change process in step S3 will be described indetail, with reference to FIG. 16. FIG. 16 is a flowchart showing indetail the rotation/size change process (step S3).

In step S21, the CPU 30 determines whether or not the touch position inthe immediately preceding frame is a vertex of the left-eye image 51 aor the right-eye image 51 b. Specifically, the CPU 30 refers to theimmediately preceding touch position data 74 to determine whether or notthe immediately preceding touch position falls within a predeterminedarea in which the vertex of the left-eye image 51 a or the right-eyeimage 51 b is included. If the determination result is affirmative, theCPU 30 next executes a process of step S22. On the other hand, if thedetermination result is negative, the CPU 30 ends the rotation/sizechange process.

In step S22, the CPU 30 calculates a vector extending from the touchposition in the immediately preceding frame to the current touchposition. Specifically, the CPU 30 refers to the current touch positiondata 73 and the immediately preceding touch position data 74 tocalculate a vector in which the immediately preceding touch position isa start point of the vector and the current touch position is an endpoint of the vector. The CPU 30 stores the calculated vector in the mainmemory 31. Next, the CPU 30 executes a process of step S23.

In step S23, the CPU 30 determines whether or not a distance between thetouch position in the immediately preceding frame and the current touchposition is equal to or less than a threshold value. An amount ofrotation or change in size of the image (the left-eye image 51 a or theright-eye image 51 b) selected by the immediately preceding touchposition is restricted by the process of step S23. Specifically, the CPU30 determines whether or not the magnitude of vector calculated in stepS22 is equal to or less than a predetermined threshold value. If thedetermination result is affirmative, the CPU 30 next executes a processof step S24. On the other hand, if the determination result is negative,the CPU 30 ends the rotation/size change process.

In step S24, the CPU 30 rotates or changes the size of the right-eyeimage or the left-eye image, according to the calculated vector.Specifically, the CPU 30 rotates or changes the size of the imageselected by the immediately preceding touch position, based on thedirection and the magnitude of vector calculated in step S22. Forexample, if the calculated direction of vector is a diagonal directionof the selected image (if equal to or less than the predeterminedangle), the CPU 30 enlarges the selected image, according to themagnitude of vector. Here, the diagonal direction indicates a directionextending from the center of the selected image toward the vertexdesignated by the immediately preceding touch position. For example, ifthe calculated direction of vector is opposite to the above-describeddiagonal direction, the CPU 30 reduces the selected image. Also, forexample, if the calculated direction of vector is perpendicular to theabove-described diagonal direction, (if within the range of thepredetermined angle) the CPU 30 rotates the selected image about thecenter of the selected image, according to the magnitude of vector.Next, the CPU 30 ends the rotation/size change process.

Returning to FIG. 14, the CPU 30 next executes a process of step S4after the process of step S3.

In step S4, the CPU 30 executes a zoom process. In step S4, the CPU 30zooms (enlarges or reduces) the stereoscopic image 61 displayed on thestereoscopic image display device 11, based on the touch positiondetected in step S1. The zoom process in step S4 will be described indetail, with reference to FIG. 17. FIG. 17 is a flowchart showing indetail the zoom process (step S4).

In step S31, the CPU 30 determines whether or not the current touchposition falls within the display area of the zoom adjustment bar 56.Specifically, the CPU 30 refers to the current touch position data 73 ofthe main memory 31 to determine whether or not the current touchposition is present within the display area (an area in which the zoomadjustment bar 56 is displayed on the screen of the planar image displaydevice 12) of the zoom adjustment bar 56. If the determination result isaffirmative, the CPU 30 next executes a process of step S32. On theother hand, if the determination result is negative, the CPU 30 ends thezoom process.

In step S32, the CPU 30 moves the slider 57 of the zoom adjustment bar56 to the current touch position. In step S32, the slider 57 of the zoomadjustment bar 56 is moved on the zoom adjustment bar 56 in thehorizontal direction. Specifically, the CPU 30 calculates a position onthe zoom adjustment bar 56, which corresponds to the current touchposition, and stores the calculated position in the zoom adjustment data76 of the main memory 31. Next, the CPU 30 executes a process of stepS33.

In step S33, the CPU 30 makes a zoom setting of the stereoscopic image61. The process of step S33 is a setting process for performing zoom ofthe stereoscopic image 61, which is displayed on the stereoscopic imagedisplay device 11 in step S6 described below. Specifically, the CPU 30determines a level of enlargement or reduction of both the left-eyeimage 51 a and the right-eye image 51 b, according to the position ofthe slider 57 of the zoom adjustment bar 56, and stores the determinedlevel in the main memory 31. Next, the CPU 30 executes a process of stepS34.

In step S34, the CPU 30 sets the stereoscopic image display frame 59.Specifically, the CPU 30 calculates an area of the stereoscopic image61, which is displayed on the stereoscopic image display device 11,based on the zoom setting of the stereoscopic image 61 in step S33. Thatis, the CPU 30 calculates the position and size of the stereoscopicimage display frame 59, and stores the obtained data in the main memory31 as the stereoscopic image display frame data 77. The stereoscopicimage display frame 59 is a frame which is displayed in the imagedisplay region 50 of the planar image display device 12, and indicativeof the areas of the left-eye image 51 a and the right-eye image 51 b,which correspond to the area of the stereoscopic image 61 displayed onthe stereoscopic image display device 11. When the stereoscopic image 61is enlarged by zooming in, there is a case where merely respectivepositions of the left-eye image 51 a and the right-eye image 51 b aredisplayed on the stereoscopic image display device 11. Even if thestereoscopic image 61 is enlarged by zooming in, if the entirety of theleft-eye image 51 a and the entirety of the right-eye image 51 b aredisplayed on the stereoscopic image display device 11, the stereoscopicimage display frame 59 is not displayed. Next, the CPU 30 ends the zoomprocess.

Returning to FIG. 14, the CPU 30 next executes a process of step S5after the process of step S4.

In step S5, the CPU 30 executes a scrolling process. In step S5, the CPU30 scrolls the stereoscopic image 61 displayed on the stereoscopic imagedisplay device 11, based on the touch position detected in step S1. Thescrolling process in step S5 will be described in detail, with referenceto FIG. 18. FIG. 18 is a flowchart showing in detail the scrollingprocess (step S5).

In step S41, the CPU 30 determines whether or not the touch position inthe immediately preceding frame falls within the display area of theleft-eye image 51 a or the right-eye image 51 b. Specifically, the CPU30 refers to the immediately preceding touch position data 74 todetermine whether or not the immediately preceding touch position fallswithin the display area of the left-eye image 51 a or the right-eyeimage 51 b. If the determination result is affirmative, the CPU 30 nextexecutes a process of step S42. On the other hand, if the determinationresult is negative, the CPU 30 ends the scrolling process.

In step S42, the CPU 30 calculates a vector extending from the touchposition in the immediately preceding frame to the current touchposition. Specifically, the CPU 30 refers to the current touch positiondata 73 and the immediately preceding touch position data 74 tocalculate a vector in which the immediately preceding touch position isthe start point of the vector and the current touch position is the endpoint of the vector. The CPU 30 stores the obtained vector in the mainmemory 31. Next, the CPU 30 executes a process of step S43.

In step S43, the CPU 30 determines whether or not the distance betweenthe touch position in the immediately preceding frame and the currenttouch position is equal to or less than the threshold value. An amountof scrolling of the stereoscopic image 61 is restricted by the processof step S43. Specifically, the CPU 30 determines whether or not themagnitude of vector calculated in step S42 is equal to or less than thepredetermined threshold value. If the determination result isaffirmative, the CPU 30 next executes a process of step S44. On theother hand, if the determination result is negative, the CPU 30 ends thescrolling process.

In step S44, the CPU 30 sets a direction in which the stereoscopic image61 displayed on the stereoscopic image display device 11 is scrolled anda scroll amount thereof. Specifically, the CPU 30 determines a directionopposite to the direction of the vector calculated in step S42, andstores the determined direction in the main memory 31 as the directionin which the stereoscopic image 61 is scrolled. Therefore, the objectimage included in the stereoscopic image 61 moves in the direction inwhich the user moves the stick 16. Also, the CPU 30 determines thescroll amount, according to the magnitude of vector which is calculatedin step S42, and stores the determined scroll amount in the main memory31. Next, the CPU 30 executes a process of step S45.

In step S45, the CPU 30 sets the stereoscopic image display frame 59.The process of step S45 is the same as that of step S34 described above.Specifically, the CPU 30 calculates the area of the stereoscopic image61 displayed on the stereoscopic image display device 11, based on thescroll setting of the stereoscopic image 61 in step S44. That is, theCPU 30 calculates the position of the stereoscopic image display frame59, and stores the calculated position in the main memory 31 as thestereoscopic image display frame data 77. Next, the CPU 30 ends thescrolling process.

Returning to FIG. 14, the CPU 30 next executes a process of step S6after the process of step S5.

In step S6, the CPU 30 displays the stereoscopic image 61 on thestereoscopic image display device 11. In step S6, the left-eye image 51a and the right-eye image 51 b, which have been adjusted in steps S2 toS5, are displayed on the stereoscopic image display device 11, therebydisplaying the stereoscopic image 61. Specifically, the CPU 30 shiftsthe respective positions of the left-eye image 51 a and the right-eyeimage 51 b by the amounts of shift, which has been set by the process ofstep S2, in the horizontal direction and the vertical direction, andsynthesizes the left-eye image 51 a and the right-eye image 51 b. Also,the CPU 30 synthesizes the left-eye image 51 a and the right-eye image51 b by using the image (the left-eye image 51 a or the right-eye image51 b), which has been rotated or changed in size in step S3. Morespecifically, the CPU 30 divides each of the two images, which have beenadjusted in step S2 or S3, into rectangle-shaped images each having oneline of pixels aligned in the vertical direction, and alternately alignsthe rectangle-shaped images of the two images, thereby synthesizing thetwo images. Furthermore, the CPU 30 sets the display area, based on thezoom setting set by the zoom process in step S4, or the scroll settingset by the scrolling process in step S5. For example, if the zoomsetting has been made in step S4, the CPU 30 sets the display area,according to the determined level of enlargement or reduction, andenlarges or reduces (digital zoom) the areas of the left-eye image 51 aand the right-eye image 51 b, which correspond to the display area.Moreover, for example, if the scroll setting has been made in step S5,the CPU 30 sets the display area, based on the scrolling direction andthe scroll amount. Merely a superimposed area when the left-eye image 51a and the right-eye image 51 b adjusted in steps S2 to S5 aresuperimposed one on the other is set as the display area. The CPU 30then displays on the stereoscopic image display device llthe displayarea of the synthesized image, thereby displaying the stereoscopicimage. Next, the CPU 30 executes a process of step S7.

In step S7, the CPU 30 displays the left-eye image 51 a and theright-eye image 51 b on the planar image display device 12. In step S7,the left-eye image 51 a and the right-eye image 51 b adjusted in stepsS2 to S5 are displayed on the planar image display device 12.Specifically, the CPU 30 shifts the position of the left-eye image 51 aand the position of the right-eye image 51 b in the horizontal andvertical directions by the respective amounts of shift set by theprocess in step S2, makes the two images semi-transparent andsuperimposes one on the other. The CPU 30 then displays a resultingsuperimposed image in the image display region 50 of the planar imagedisplay device 12. Furthermore, the CPU 30 makes the left-eye image 51 aand the right-eye image 51 b semi-transparent and superimposes one onthe other by using the image (the left-eye image 51 a or the right-eyeimage 51 b) rotated or changed in size in step S3. The CPU 30 thendisplays a resulting superimposed image on the planar image displaydevice 12. Here, the image display region 50 of the planar image displaydevice 12 is small as compared to the screen of the stereoscopic imagedisplay device 11. Therefore, the CPU 30 reduces the left-eye image 51 aand the right-eye image 51 b, according to the ratio of size of theimage display region 50 to the size of the screen of the stereoscopicimage display device 11, and displays the left-eye image 51 a and theright-eye image 51 b on the planar image display device 12. Furthermore,the CPU 30 displays on the planar image display device 12 thestereoscopic image display frame 59 set by the zoom process (S34) instep S4 or the scrolling process (S45) in step S5. As described above,although the stereoscopic image 61 displayed on the stereoscopic imagedisplay device 11 is zoomed or scrolled, the images displayed on theplanar image display device 12 are not zoomed or scrolled. That is, theentirety of the left-eye image 51 a and the entirety of the right-eyeimage 51 b are displayed on the planar image display device 12 even whenthe entirety of the stereoscopic image 61 is not displayed on thestereoscopic image display device 11 because the stereoscopic image 61is zoomed or scrolled. This allows the user to adjust the images, whileverifying the entirety of the left-eye image 51 a and the entirety ofthe right-eye image 51 b, even when the stereoscopic image 61 is zoomedor scrolled. Next, the CPU 30 executes a process step S8.

In step S8, the CPU 30 determines whether or not the adjustment isended. The CPU 30 determines, for example, whether or not apredetermined operation has been performed by the user (whether or notany button provided on the lower housing 13 b (not shown) has beenpressed, for example). If the determination result is negative, the CPU30 next executes a process of step S1. If the determination result isaffirmative, the CPU 30 ends the process shown in FIG. 14. This is theend of the image display control process according to the presentembodiment.

The content and the order of the above-described processes are merelyillustrative. That is, the position adjustment process, therotation/size change process, and the like are merely specific examples,and the relative positions, relative sizes, and relative rotations ofthe left-eye image 51 a and the right-eye image 51 b may be adjusted inany manner. Also, the above-described processes may be in any order.

As described above, by adjusting the positions, sizes or rotations ofthe left-eye image 51 a and the right-eye image 51 b, the user canadjust the appearance of the stereoscopic image 61. The user can adjustthe positions, sizes or rotations of the left-eye image 51 a and theright-eye image 51 b on the screen of the planar image display device12, while seeing the stereoscopic image 61 displayed on the stereoscopicimage display device 11. Therefore, the user can easily adjust theappearance of the stereoscopic image 61.

The left-eye image 51 a and the right-eye image 51 b taken by anotherdevice may be loaded to the image display apparatus 10 via the storeddata memory 34. Also, the left-eye image 51 a and the right-eye image 51b taken by another device may be provided to the image display apparatus10 via the communication module 35.

Also, information indicative of the amounts of adjustment in thepositions, sizes, and rotations by which the left-eye image 51 a and theright-eye image 51 b are adjusted in step S2 and S3 may be stored in thestored data memory 34, together with the image data of the left-eyeimage 51 a and the right-eye image 51 b, respectively. The informationmay be stored as part of the image data of each of the left-eye image 51a and the right-eye image 51 b. The stored data memory 34 may beconnected to another apparatus different from the image displayapparatus 10, and the stereoscopic image, which is adjusted by using theimage data stored in the stored data memory 34 and the informationindicative of the amounts of adjustment, may be displayed on a screen ofthe another apparatus.

Further, in the above embodiment, even when the stereoscopic image iszoomed or scrolled, the planar image (including the left-eye image 51 aand the right-eye image 51 b) displayed on the planar image displaydevice 12 are not zoomed or scrolled. In another embodiment, when thestereoscopic image is zoomed or scrolled, the planar image displayed onthe planar image display device 12 may also be zoomed or scrolled. Thatis, in another embodiment, by performing scrolling or zooming of thestereoscopic image, respective portions of the left-eye image 51 a andthe right-eye image 51 b displayed on the planar image display device 12may be displayed on the planar image display device 12 (the entirety ofthe left-eye image 51 a and the entirety of the right-eye image 51 b maynot be displayed).

Specifically, as shown in FIG. 19, by performing scrolling or zooming ofthe stereoscopic image 61, the left-eye image 51 a and the right-eyeimage 51 b displayed on the planar image display device 12 may also bezoomed or scrolled. FIG. 19 is a diagram illustrating a state in whichthe left-eye image 51 a and the right-eye image 51 b displayed on theplanar image display device 12 are zoomed or scrolled in response toperforming zooming or scrolling of the stereoscopic image 61. In FIG.19, by performing zooming or scrolling of the stereoscopic image 61,portions of the left-eye image 51 a and the right-eye image 51 b aremade semi-transparent, superimposed one on the other, and displayed onthe planar image display device 12. Specifically, in FIG. 19, a portionwhere the left-eye image 51 a and the right-eye image 51 b aresuperimposed one on the other and a portion where the left-eye image 51a and the right-eye image 51 b are not superimposed one on the other aredisplayed on the screen of the planar image display device 12. Also, astereoscopic image, which corresponds to the portion where the left-eyeimage 51 a and the right-eye image 51 b are superimposed one on theother, is displayed on the screen of the stereoscopic image displaydevice 11. As shown in FIG. 19, the left-eye image 51 a and theright-eye image 51 b displayed on the planar image display device 12 areenlarged by the same ratio as the magnification ratio of thestereoscopic image 61. Since the screen of the stereoscopic imagedisplay device 11 is large as compared to the image display region 50 ofthe planar image display device 12, the object image 63 is displayedlarger than the object images 53 a and 53 b. The left-eye image 51 a andthe right-eye image 51 b displayed on the planar image display device 12are scrolled in response to performing scrolling of the stereoscopicimage 61. That is, the images displayed on the planar image displaydevice 12 are the same as the image displayed on the stereoscopic imagedisplay device 11. As described above, similar to the stereoscopic imagedisplayed on the stereoscopic image display device 11, the planar imagedisplayed on the planar image display device 12 is also zoomed and/orscrolled, and thereby it is easy for the user to understand thecorrespondence between the stereoscopic image and the planar image.

Further, in the above embodiment, the image, in which the left-eye image51 a and the right-eye image 51 b are made semi-transparent andsuperimposed one on the other, is displayed on the planar image displaydevice 12. In another embodiment, the images may be displayed in anymanner if the amounts of shift (amounts of shift in positions, sizes androtations) of the left-eye image 51 a and the right-eye image 51 b arerecognizable to the user. For example, the contours of the two imagesmay be highlighted so as to be recognizable to the user, and the twoimages may be superimposed one on the other without being madesemi-transparent. That is, one image may be displayed over another imageso that the one image hides a portion of the other image.

Any operation, not limited to the above-described operation, may beperformed to adjust the positions, sizes, or rotations of the left-eyeimage 51 a and/or the right-eye image 51 b. For example, a button (crossbutton or the like) may be provided on the lower housing 13 b, and thepositions of the left-eye image 51 a and/or the right-eye image 51 b maybe adjusted by using the button. Specifically, for example, in the casewhere is the image to be moved is selected by using the stick 16, and ifa right-direction button of the cross button is pressed, the selectedimage may be moved in the rightward direction, and if a left-directionbutton is pressed, the selected image may be moved in the leftwarddirection. Furthermore, for example, in the case where the image to berotated is selected by using the stick 16, and if the right-directionbutton of the cross button is pressed, the selected image may be rotatedin the clockwise direction, and if the left-direction button is pressed,the selected image may be rotated in the anticlockwise direction.Further, for example, in the case where the image to be enlarged orreduced is selected by using the stick 16, and if an up-direction buttonof the cross button is pressed, the selected image may be enlarged, andif a down-direction button is pressed, the selected image may bereduced.

Further, while the display configured to display a stereoscopic imagewhich can be viewed by the naked eye is employed in the presentembodiment, the present invention is applicable to achieving thestereoscopic vision which requires glasses having the time divisionscheme or the deflecting scheme, the anaglyphic format (the red-blueglasses format), or the like.

(Second Embodiment)

Next, a second embodiment will be described. In the second embodiment,the image display apparatus 10 described above also operates as a gameapparatus. On a lower housing 13 b of the image display apparatus 10according to the second embodiment, a plurality of operation buttons (across button and other buttons), which are operated by a user, areprovided.

The image display apparatus 10 according to the second embodimentoperates in a first mode and a second mode. In the first mode, asdescribed in the first embodiment, images which are taken by using aleft-eye image imaging section 18 a and a right-eye image imagingsection 18 b are used, and a stereoscopic image is displayed on thestereoscopic image display device 11. In the second mode, images takenby a virtual stereo camera are used, and a stereoscopic image isdisplayed, in real time, on a stereoscopic image display device 11. Inthe second mode, the images taken of a virtual space by the virtualstereo camera (a left-eye virtual camera and a right-eye virtual camera)are displayed on the stereoscopic image display device 11. In the secondmode, the virtual stereo camera takes images of a three-dimensionalvirtual space, and thereby a left-eye image and a right-eye image, whichhas a predetermined parallax therebetween, are generated. The imagedisplay apparatus 10 synthesizes the left-eye image and the right-eyeimage in which the virtual space is taken in real time, therebydisplays, in real time, the stereoscopic image on the stereoscopic imagedisplay device 11.

In the second mode, for example, a role-playing game is assumed, inwhich a story advances such that a player character operated by the userexplores the three-dimensional virtual space. In the role-playing game,various game scenes (for example, a scene in which the player characterexplores a cave, or a scene in which the player character explores aforest) are prepared. For the virtual stereo camera, settings (such as azoom setting, setting of a focus position, a setting of a distancebetween the left-eye virtual camera and the right-eye virtual camera)are previously made depending on the various game scenes. For example,for the scene in which the player character explores the cave, thedistance between the left-eye virtual camera and the right-eye virtualcamera is previously set to a first distance, and for the scene in whichthe player character explores the forest, the distance between theleft-eye virtual camera and the right-eye virtual camera is previouslyset to a second distance.

The distance of the two virtual cameras (the left-eye virtual camera andthe right-eye virtual camera) influences the appearance of variousthree-dimensional objects (a rock object, a tree object, and the like,for example), which are present in the three-dimensional virtual space,in the depth direction. For example, in the case where the distancebetween the two virtual cameras is relatively long, and if an image ofthe three-dimensional object is taken, the stereoscopic image, which hasthe three-dimensional object being longer in the depth direction, isdisplayed. The distance between the two virtual cameras is previouslydetermined by a game architect, according to each scene of the game.

Here, in the second embodiment, the distance between the two virtualcameras is adjusted according to a position of a hardware slider 14 (seeFIG. 1) of the image display apparatus 10. That is, the user of theimage display apparatus 10 can adjust, by using the hardware slider 14,the distance between the two virtual cameras to make the stereoscopicimage easy to see for the user. Specifically, for example, if thehardware slider 14 is positioned at the center of a range of movementthereof, the distance between the two virtual cameras is set to apredetermined value (a default value). Also, for example, if thehardware slider 14 is positioned at the right end of the range ofmovement thereof, the distance between the two virtual cameras is set to125% of the default value. Furthermore, for example, if the hardwareslider 14 is positioned at the left end of the range of movementthereof, the distance between the two virtual cameras is set to 75% ofthe default value.

As described above, in the second embodiment, the user can adjust thedistance between the two virtual cameras by using the hardware slider14. This allows the user to adjust the appearance of the stereoscopicimage.

In the first mode, since the distance between the left-eye image imagingsection 18 a and the right-eye image imaging section 18 b cannot beadjusted, the hardware slider 14 is used as a switch to switch betweenwhether or not to display the stereoscopic image on the stereoscopicimage display device 11. In the first mode, for example, if the hardwareslider 14 is positioned at the right end, the stereoscopic image isdisplayed on the stereoscopic image display device 11, and if thehardware slider 14 positioned at the left end, the stereoscopic image isnot displayed on the stereoscopic image display device 11. When thestereoscopic image is not displayed on the stereoscopic image displaydevice 11, image may not be displayed on the stereoscopic image displaydevice 11, or a planar image may be displayed.

Next, a process performed in the image display apparatus 10 according tothe second embodiment will be described in detail. Initially, main datastored in a main memory 31 during the process will be described. FIG. 20is a diagram illustrating a memory map of the main memory 31 of theimage display apparatus 10 according to the second embodiment. As shownin FIG. 20, a data storage area 80 is provided in the main memory 31. Inthe data storage area 80, virtual camera data 81, operation data 82,character data 83, and the like, are stored. Other data stored in themain memory 31 are a program for executing the above-described process,image data of the various objects appear in the game, and the like.

The virtual camera data 81 is data regarding setting of the virtualstereo camera present in a game space. The setting of the virtual stereocamera includes the distance between the left-eye virtual camera and theright-eye virtual camera, which are components of the virtual stereocamera, the zoom setting of the virtual stereo camera, positions ofrespective points of views of the virtual stereo camera, and the like.

The operation data 82 is data indicative of inputs to the plurality ofoperation buttons (not shown). When each operation button is pressed bythe user, data which indicates that the operation button has beenpressed is stored in the main memory 31.

The character data 83 is data regarding the player character which isoperated by the user and which is present in the game space, andincludes the position of the player character in the game space and thecharacter information of the player character.

Next, the process according to the second embodiment will be describedin detail, with reference to FIG. 21. FIG. 21 is a main flowchartshowing in detail the process according to the second embodiment. Whenthe image display apparatus 10 is powered on, a CPU 30 of the imagedisplay apparatus 10 executes a boot program stored in a ROM 32 toinitialize each unit, such as the main memory 31. Next, the programstored in the ROM 32 is loaded into the main memory 31, and the CPU 30starts executing the program. The program may be stored in the storeddata memory 34, or provided to the image display apparatus 10 via thecommunication module 35. The flowchart shown in FIG. 21 shows a processperformed after the process is completed. In FIG. 21, the description ofprocesses, which do not directly relate to the present invention, isomitted. A processing loop of step S52 through step S56 shown in FIG. 21is repeatedly executed for each frame (for example, 1/30 second, whichis referred to as frame time).

Initially, in step S51, the CPU 30 determines whether or not the firstmode has been selected. Specifically, the CPU 30 displays a screen,which allows the user to select the first mode or the second mode, onthe planar image display device 12 and detects an input from the user.If the first mode has been selected by the user, the CPU 30 nextexecutes a process of step S57. On the other hand, if the second modehas been selected by the user, the CPU 30 next executes a process ofstep S52.

In step S52, the CPU 30 sets the distance between the left-eye virtualcamera and the right-eye virtual camera, according to the position ofthe hardware slider 14. Specifically, the CPU 30 detects the position ofthe hardware slider 14 to calculate the distance between the two virtualcameras, and stores the obtained data in the main memory 31 as thevirtual camera data 81. The CPU 30 next executes a process of step S53.

In step S53, the CPU 30 acquires the operation data. Specifically, theCPU 30 refers to the main memory 31 to acquire the operation dataregarding the plurality of operation buttons. The CPU 30 next executes aprocess of step S54.

In step S54, the CPU 30 executes a game process. Specifically, the CPU30 updates the position of the player character in the game space,causes the player character to perform a predetermined movement, and thelike, based on the operation data acquired in step S53. Further, the CPU30 causes objects, other than the player character, which are present inthe game space, to perform the predetermined movement. Furthermore, theCPU 30 updates the positions of the respective points of views of thevirtual stereo camera, updates the zoom setting, and the like. The CPU30 next executes a process of step S55.

In step S55, the CPU 30 displays the stereoscopic image on thestereoscopic image display device 11. Specifically, the CPU 30 takesimages of the game space by the virtual stereo camera to acquire theleft-eye image and the right-eye image. The CPU 30 then synthesizes theleft-eye image and the right-eye image to generate stereoscopic imagedata, and displays the stereoscopic image on the stereoscopic imagedisplay device 11. The CPU 30 next executes a process of step S56.

In step S56, the CPU 30 determines whether or not the game is ended. Forexample, the CPU 30 determines whether or not a button (one of theplurality of operation buttons), which indicates that the game is ended,has been pressed by the user. If the determination result is negative,the CPU 30 executes again the process of step S52. If the determinationresult is affirmative, the CPU 30 ends the process shown in FIG. 21.

In step S57, the CPU 30 executes the process of the first mode. Althoughthe process of step S57 is the same as the process (the steps S1 to S8shown in FIG. 14) in the first embodiment, a determination process ofstep S58 is performed between the step S5 and step S6 in FIG. 14, asshown in FIG. 22. FIG. 22 is a flowchart showing in detail the processof the first mode. In step S58, the CPU 30 determines whether or not thehardware slider 14 is positioned at a predetermined position (the rightend, for example). If the determination result is affirmative, the CPU30 next executes a process of step S6. If the determination result isnegative, the CPU 30 next executes a process of step S7.

As described above, in the second embodiment, the image displayapparatus 10 operates in the first mode, in which the stereoscopic imageis displayed by using the left-eye image and the right-eye image whichare already taken, and in the second mode in which the stereoscopicimage is displayed by using the left-eye image and the right-eye imagetaken by the virtual stereo camera present in the virtual space.

In the first mode, the left-eye image and the right-eye image may be theimages taken by the stereo camera 18 (the left-eye image imaging section18 a and the right-eye image imaging section 18 b), or images taken byanother stereo camera. In the first mode, since the images, which arealready taken, are used, the parallax caused by the distance between theleft-eye image imaging section 18 a and the right-eye image imagingsection 18 b cannot be changed. Therefore, in the first mode, thehardware slider 14 functions as a switch to switch betweendisplaying/not displaying the stereoscopic image. This allows the userto switch between ON/OFF of the stereoscopic display by using thehardware slider 14.

On the other hand, in the second mode, since the left-eye image and theright-eye image are the images taken by the virtual stereo camera (theleft-eye virtual camera and the right-eye virtual camera), the distancebetween the left-eye virtual camera and the right-eye virtual camera canbe arbitrarily changed. In the second mode, the distance between thevirtual cameras (the distance between the left-eye virtual camera andthe right-eye virtual camera) is changed by using the hardware slider14. Therefore, the user can adjust the appearance of the stereoscopicimage. Furthermore, the distance between the virtual cameras can bechanged from the default value, according to the position of thehardware slider 14, and thus the user need not to adjust the hardwareslider 14, according to the game scene. That is, the default value ofthe distance between the virtual cameras, which is set for each gamescene, is previously determined by the architect. Therefore, thestereoscopic image taken with such settings of the virtual cameras doesnot necessarily cause no sense of discomfort for all users. For example,it may be easy for a certain user to see the image as the stereoscopicimage, when the distance between the virtual cameras is set to 80% ofthe default value in each game scene. Therefore, setting the ratio ofthe value of the distance between the virtual cameras to the defaultvalue, according to the position of the hardware slider 14 obviates theneed for adjusting the position of the hardware slider 14 in each gamescene.

In the second mode, the amount of shift of the left-eye image and theright-eye image in the horizontal direction may be set according to theposition of the hardware slider 14. That is, the amount of shift of theleft-eye image and the right-eye image in the horizontal direction maybe adjusted, according to the position of the hardware slider 14,instead of adjusting the distance between the virtual cameras.

Also, even in the second mode, the amount of shift of the left-eye imageand the right-eye image (the amount of shift in the horizontaldirection) may be adjusted by using the position adjustment bar 54, asdescribed in the first embodiment. This allows the user to move apredetermined object present in the game space in a directionperpendicular to the screen of the stereoscopic image display device 11.

Furthermore, in the first and second embodiments, the image displayapparatus 10 having a handheld type, which includes both thestereoscopic image display device 11 and the planar image display device12, is assumed. In another embodiment, these devices may be configuredto be independently of one another and connected to one another. Forexample, a first display device capable of displaying a stereoscopicallyvisible image, a second display device configured to display merely aplanar image, and a control apparatus which performs the processesdescribed above may be configured to be hardware independently of oneanother. Then, these devices and apparatus may function as the imagedisplay control system by being connected with one another by wire orwirelessly.

Further, in another embodiment, a display device capable of settingsimultaneously a stereoscopic image display area, in which astereoscopic image is displayed, and a planar image display area, inwhich a planer images is displayed, may be employed as the stereoscopicimage display device 11 and the planar image display device 12,respectively. That is, the stereoscopic image display area and theplanar image display area of such display devices may be employed asstereoscopic image display means, and planar image display means,respectively.

Further, in another embodiment, the adjustment method described abovemay be applied to any information processing apparatus, which includes adisplay device and a touch panel (for example, PDAs (Personal DigitalAssistant), mobile phones, and the like), and personal computers whichinclude a pointing device such as a mouse.

Further, in the embodiment described above, the stereoscopic image isadjusted (the respective positions of the left-eye image and theright-eye image are adjusted), the stereoscopic image is zoomed,scrolled, and the like, by the operations on the touch panel. In anotherembodiment, a pointing device, such as a mouse, may be operated toadjust the stereoscopic image, and the like. For example, the slider ofthe position adjustment bar, which is displayed on the screen, may beadjusted by a mouse operation.

Further, in the embodiment described above, the processes shown in theabove-described flowcharts are performed by the CPU 30 of the imagedisplay apparatus 10 executing a predetermined program. In anotherembodiment, a part or the entirety of the processes may be performed bya dedicated circuit included in the image display apparatus 10. Forexample, a dedicated GPU (Graphics Processing Unit) or the like, whichgenerates an image to be displayed on the stereoscopic image displaydevice 11, may be provided.

While example embodiments of the present invention has been described indetail, the foregoing description is in all aspects illustrative and notrestrictive. It is understood that numerous other adjustments andvariations can be devised without departing from the scope of theinvention.

What is claimed is:
 1. A non-transitory computer-readable storage mediumhaving stored therein a display control program executed by a computerof a display control apparatus for displaying a stereoscopic image onfirst display configured to display a stereoscopically visible image byusing a right-eye image and a left-eye image which have a parallaxtherebetween, the display control program causing the computer toprovide functionality comprising: an adjustment for adjusting at leastone of relative positions, relative sizes, and relative rotations of theright-eye image and the left-eye image; a first display control fordisplaying on the first display the right-eye image adjusted by theadjustment and the left-eye image adjusted by the adjustment so as to beviewed with a right eye and a left eye of the user, respectively, todisplay the stereoscopic image on the first display; and a seconddisplay control for superimposing the right-eye image and the left-eyeimage which are adjusted by the adjustment and constitute thestereoscopic image displayed on the first display, one on the other, anddisplaying a resulting superimposed planar image on a second displayconfigured to display a planar image.
 2. The non-transitorycomputer-readable storage medium having stored therein the displaycontrol program according to claim 1, wherein in the case where theright-eye image adjusted by the adjustment and the left-eye imageadjusted by the adjustment are superimposed one on the other, the firstdisplay control displays on the first display merely a superimposedarea, which is a superimposed portion of the right-eye image adjusted bythe adjustment and the left-eye image adjusted by the adjustment, of thestereoscopic image; and the second display control displays on thesecond display a non-overlapping area which is a portion where theright-eye image and the left-eye image are not superimposed one on theother, in addition to the superimposed area of the right-eye image andthe left-eye image which are adjusted by the adjustment.
 3. Thenon-transitory computer-readable storage medium having stored thereinthe display control program according to claim 1, wherein the firstdisplay control performs zooming of the stereoscopic image by changingthe respective sizes of the right-eye image and the left-eye image. 4.The non-transitory computer-readable storage medium having storedtherein the display control program according to claim 1, wherein thefirst display control scrolls the stereoscopic image by changing therespective positions of the right-eye image and the left-eye image. 5.The non-transitory computer-readable storage medium having storedtherein the display control program according to claim 3, wherein thesecond display control displays on the second display an entirety of theright-eye image and an entirety of the left-eye image.
 6. Thenon-transitory computer-readable storage medium having stored thereinthe display control program according to claim 5, wherein in the casewhere a portion of the stereoscopic image is displayed on the firstdisplay by performing zooming or scrolling of the stereoscopic image bythe first display control, the second display control displays on thesecond display a stereoscopic image display frame indicative ofrespective areas of the right-eye image and the left-eye image whichcorrespond to the portion of the stereoscopic image.
 7. Thenon-transitory computer-readable storage medium having stored thereinthe display control program according to claim 1, wherein a designatedcoordinate detection for detecting a designated coordinate correspondingto a display position on the second display is connected to the displaycontrol apparatus, the display control program further causes thecomputer to function as: a first adjustment bar control for displaying afirst adjustment bar on the second display, and adjusting a slider ofthe first adjustment bar, according to the designated coordinatedetected by the designated coordinate detection, and the adjustmentadjusts at least one of the relative positions, the relative sizes, andthe relative rotations of the right-eye image and the left-eye image,according to a position of the slider, of the first adjustment bar,which is adjusted by the first adjustment bar control .
 8. Thenon-transitory computer-readable storage medium having stored thereinthe display control program according to claim 7, wherein the displaycontrol program further causes the computer to function as: a secondadjustment bar control for displaying a second adjustment bar on thesecond display, and adjusting a slider of the second adjustment bar,according to the designated coordinate detected by the designatedcoordinate detection, and the first display control zooms thestereoscopic image, according to a position of the slider, of the secondadjustment bar, which is adjusted the second adjustment bar control. 9.The non-transitory computer-readable storage medium having storedtherein the display control program according to claim 7, wherein thedisplay control program further causes the computer to function as: adirection detection for detecting a direction inputted by the user,based on the designated coordinate detected by the designated coordinatedetection, and the first display control scrolls the stereoscopic image,based on the direction detected by the direction detection.
 10. Thenon-transitory computer-readable storage medium having stored thereinthe display control program according to claim 1, wherein the seconddisplay control sets in the second display an image display area fordisplaying therein the right-eye image and the left-eye image, and aratio of a width in an aspect ratio of the image display area is largerthan a ratio of a width in an aspect ratio of each of the right-eyeimage and the left-eye image.
 11. The non-transitory computer-readablestorage medium having stored therein the display control programaccording to claim 10, wherein designated coordinate detection fordetecting a designated coordinate corresponding to a display position onthe second display is connected to the display control apparatus, thedisplay control program further causes the computer to function as: afirst adjustment bar control for displaying a first adjustment barhaving a slider configured to move in the horizontal direction of ascreen of the second display in an area, on the screen of the seconddisplay, which is different from the image display area, and adjustingthe slider, according to the designated coordinate detected by thedesignated coordinate detection, and the adjustment shifts the right-eyeimage and/or the left-eye image in the horizontal direction, accordingto a position of the slider adjusted by the first adjustment barcontrol.
 12. The non-transitory computer-readable storage medium havingstored therein the display control program according to claim 1, whereindesignated coordinate detection for detecting a designated coordinatecorresponding to a display position on the second display is connectedto the display control apparatus, the display control program furthercauses the computer to function as: a first adjustment bar control fordisplaying on the second display a first adjustment bar having a sliderconfigured to move in the horizontal direction of a screen of the seconddisplay, and adjusting a position of the slider of the first adjustmentbar, according to the designated coordinate detected by the designatedcoordinate detection, in accordance with the designated coordinatedetected by the designated coordinate detection, the first adjustmentbar control moves the first adjustment bar itself in the verticaldirection of the screen of the second display within a range smallerthan a range of movement of the slider, in the case where the slider ismoved by the first adjustment bar control in the horizontal direction,the adjustment shifts the position of the right-eye image and/or theposition of the left-eye image in the horizontal direction, according toan amount of movement of the slider, and in the case where the firstadjustment bar is moved by the first adjustment bar control in thevertical direction, the adjustment shifts the position of the right-eyeimage and/or the position of the left-eye image in the verticaldirection, according to an amount of movement of the first adjustmentbar.
 13. The non-transitory computer-readable storage medium havingstored therein the display control program according to claim 1, whereinthe adjustment is able to adjust the relative positions of the right-eyeimage and the left-eye image in the horizontal direction within a firstrange, and in the vertical direction within a second range smaller thanthe first range.
 14. The non-transitory computer-readable storage mediumhaving stored therein the display control program according to claim 1,wherein designated coordinate detection for detecting a designatedcoordinate corresponding to a display position on the second display isconnected to the display control apparatus, the display control programfurther causes the computer to function as: a first adjustment barcontrol for displaying a first adjustment bar on the second display, andadjusting a slider of the first adjustment bar, according to thedesignated coordinate detected by the designated coordinate detection,and the adjustment adjusts at least one of the relative positions,relative sizes and relative rotations of the right-eye image and theleft-eye image, according to a position of the slider, of the firstadjustment bar, which is adjusted by the first adjustment bar control,and stores in storage an adjustment amount for each stereoscopic image.15. The non-transitory computer-readable storage medium having storedtherein the display control program according to claim 1, wherein thedisplay control apparatus includes a stereo camera.
 16. Thenon-transitory computer-readable storage medium having stored thereinthe display control program according to claim 1, wherein the displaycontrol apparatus is a handheld display apparatus configured in onepiece of the first display and the second display, and the first displayand the second display are joined together so as to be foldable.
 17. Thenon-transitory computer-readable storage medium having stored thereinthe display control program according to claim 1, wherein the displaycontrol apparatus is detachably connected to storage for storing thereinthe right-eye image and the left-eye image.
 18. The non-transitorycomputer-readable storage medium having stored therein the displaycontrol program according to claim 1, wherein the display controlapparatus includes communication capable of transmission and receptionof the right-eye image and the left-eye image.
 19. The non-transitorycomputer-readable storage medium having stored therein the displaycontrol program according to claim 1, wherein the display controlapparatus includes a slider configured to be adjustable a positionthereof in a predetermined direction, the display control programfurther causes the computer to function as: a mode selection forselecting either of a first mode in which the right-eye image and theleft-eye image, which are already taken, are used and a second mode inwhich the right-eye image and the left-eye image taken of a virtualspace by of two virtual cameras, are used, in the case where the firstmode is selected by the mode selection, the first display controldisplays the stereoscopic image by using the right-eye image and theleft-eye image which are already taken, and in the case where the secondmode is selected by the mode selection, the first display controladjusts a distance between the virtual cameras, according to a positionof the slider, and displays the stereoscopic image by using theright-eye image and the left-eye image taken of the virtual space by ofthe two virtual cameras adjusted the distance therebetween.
 20. Thenon-transitory computer-readable storage medium having stored thereinthe display control program according to claim 19, wherein the firstdisplay control displays the stereoscopic image merely in the case wherethe first mode is selected by the mode selection and when the slider ispositioned at a predetermined position.
 21. A display control apparatusfor displaying a stereoscopic image on a first display configured todisplay a stereoscopically visible image by using a right-eye image anda left-eye image which have a parallax therebetween, the display controlapparatus comprising: an adjuster configured to adjust at least one ofrelative positions, relative sizes, and relative rotations of theright-eye image and the left-eye image; a first display controllerconfigured to display the stereoscopic image on the first display , bydisplaying on the first display the right-eye image adjusted by theadjustment and the left-eye image adjusted by the adjustment so as to beviewed with a right eye and a left eye of the user, respectively; and asecond display controller configured to superimpose the right-eye imageand the left-eye image, which are adjusted by the adjuster andconstitute the stereoscopic image displayed on the first display, one onthe other, and displaying a resulting superimposed planar image on asecond display configured to display a planar image.
 22. A displaycontrol system comprising: a computer system, including a computerprocessor, the computer system being at least configured to: display, ona first display, a stereoscopic image by using a right-eye image and aleft-eye image which have a parallax therebetween; display, on a seconddisplay a planar image; adjust at least one of relative positions,relative sizes, and relative rotations of the right-eye image and theleft-eye image; perform a first display control for displaying thestereoscopic image on the first display, by displaying on the firstdisplay the right-eye image adjusted by the adjustment and the left-eyeimage adjusted by the adjustment so as to be viewed with a right eye anda left eye of the user, respectively; and perform a second displaycontrol for superimposing the right-eye image and the left-eye image,which are adjusted by the adjustment and constitute the stereoscopicimage displayed on the first display, one on the other, and display aresulting superimposed planar image on a second display configured todisplay a planar image.
 23. A display control method for displaying astereoscopic image on a first display configured to display astereoscopically visible image by using a right-eye image and a left-eyeimage which have a parallax therebetween, display control methodcomprising: an adjustment step of adjusting at least one of relativepositions, relative sizes, and relative rotations of the right-eye imageand the left-eye image; a first display control step of displaying thestereoscopic image on the first display, by displaying on the firstdisplay the right-eye image adjusted by the adjustment and the left-eyeimage adjusted by the adjustment so as to be viewed with a right eye anda left eye of the user, respectively; and a second display control stepof superimposing the right-eye image and the left-eye image, which areadjusted by the adjustment and constitute the stereoscopic imagedisplayed on the first display step one on the other, and displaying aresulting superimposed planar image on a second display configured todisplay a planar image.
 24. The non-transitory computer-readable storagemedium having stored therein the display control program according toclaim 1, wherein the right-eye and left-eye images are semi-transparentand superimposed on one another to display the planar image.
 25. Thedisplay control apparatus according to claim 21, wherein the right-eyeand left-eye images are semi-transparent and superimposed on one anotherto display the planar image.
 26. The display control system according toclaim 22, wherein the right-eye and left-eye images are semi-transparentand superimposed on one another to display the planar image.
 27. Thedisplay control method according to claim 23, wherein the right-eye andleft-eye images are semi-transparent and superimposed on one another todisplay the planar image.